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PREFACE 


In  1990  the  United  Way  of  Calgary  and  area,  through  both  a Multicultural  Task 
Force  and  a community  initiative  called  Futureways,  needed  to  find  ways  to  demonstrate  that 
the  organizations  they  funded  could  reasonably  address  and  meet  the  larger  community  needs. 
The  function  of  both  the  Multicultural  Task  Force  and  the  Futureways  was  to  look  at 
vulnerable  groups  not  being  served  and  the  area  of  accessibility  generally.  The  current  study 
originated  as  part  of  the  United  Way  of  Calgary’s  Multicultural  Organizational  Change 
(MOC)  Board  Committee’s  development  of  a massive,  multi-organizational,  three-year  long, 
change  initiative.  This  pilot  program  was  intended  to  help  United  Way  funded  agencies  to 
understand  and  address  the  organizational  barriers  which  obstructed  the  provision  of  services  to 
members  of  the  more  than  65  ethnocultural  communities  in  Calgary,  Alberta,  Canada. 

As  the  initiative  took  shape  over  the  course  of  1991,  a group  of  us  recognized  the  MOC 
initiative  was  an  unprecedented  opportunity  to  study  an  “organizational  change  for  diversity” 
initiative  in  Calgaty,  from  conception  through  implementation  across  a variety  of  organizations 
in  the  not-for-profit  human  services  sector.  A participatory  appraoch  to  studying  the  MOC 
initiative  from  a variety  of  perspectives  was  considered  an  ideal  way  to  develop  a better 
understanding  of  the  change  process  in  organizations  trying  to  address  systemic  barriers  to 
people  from  diverse  ethnocultural,  racial  and  linguistic  backgrounds. 

The  MOC  Committee,  from  its  beginning  in  1991,  was  represented  by  diverse 
communities  of  Calgary  as  well  as  staff  from  the  Alberta  Multiculturalism  Commission 
(AMC).  The  AMC  had  the  mandate,  between  1990  and  1996,  through  its  Access  direction,  to, 
“assist  public  institutions,  businesses,  industries  and  organizations  to  develop  operations  and 
services  that  are  available  and  appropriate  to  the  needs  of  all  Albertans.”  To  that  end. 
Commission  set  a priority  on  working  with  the  health,  education  and  municipal  services 
sectors.  The  Commission  sought  quantitative  as  well  as  qualitative  research-based  information 
in  these  areas  to  support  and  demonstrate  the  need  for  professional  action  on  diversity  matters, 
particularly  at  a time  of  fiscal  restraint.  The  MOC  initiative  and  its  evaluation  became  a 
collaborative  venture  between  the  United  Way  and  the  AMC.  The  MOC  process  was  the 
single  largest  systemic  change  initiative  in  die  province  for  the  Multiculturalism  Commission. 
In  1992  the  Kahanoff  Foundation  also  contributed  a significant  amount  of  financial 
resources  into  the  MOC  work  in  Calgary  as  part  of  a four  city  national  initiative  involving  the 
United  Ways  of  Metro  Toronto,  Halifax  and  Vancouver.  The  federal  department  of 
Canadian  Heritage  also  contributed  to  the  completion  of  the  evaluation  of  the  MOC  initiative. 
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Participants,  including  project  planners,  agency  representatives  and  diversity 
stakeholders  had  (and  continue  to  have)  many  questions  about  the  MOC  process.  What  should 
organizations  do,  or  not  do,  in  order  to  develop  an  organizational  culture  that  value  diversity? 
How  can  agencies  provide  effective  services  to  the  broad  range  of  people  from  diverse 
backgrounds  in  Calgary?  Are  there  measurable  indicators  of  success  in  this  kind  of  process? 
What  kind  of  resources,  both  human  and  financial,  will  this  process  take?  What  is  the 
relationship  between  accessible  front-line  services  and  the  acceptance  of  diversity  within  the 
organizational  culture?  When  is  the  process  considered  “finished”?  Will  participating  in  MOC 
help  agencies  get  funded  by  the  United  Way? 

Aside  from  the  broader  organizational  change  literature,  there  was  only  one  Canadian 
example  to  point  to  in  1991  - the  YWCA  of  Metro  Toronto  (described  by  Thomas,  1987),  and 
this  example  left  many  questions  still  unanswered.  How  would  such  a change  process  actually 
work,  here  in  Calgary?  Between  the  beginning  of  the  implementation  at  the  agency  level  in 
1992/93,  and  the  last  workforce  survey  in  1996,  many  more  questions  were  raised,  and  the 
evaluation  of  MOC  took  many  forms,  including  the  development  of  a “Stakeholder’s  Group”  of 
participants  at  the  agencies,  to  attempt  to  come  to  a better  understanding  of  the  key  variables  in 
the  MOC  process. 

This  report  provides  some  answers,  but  in  no  way  is  the  final  word  on  “diversity 
change”  - many  significant  questions  remain  unanswered  and  await  further  study.  Clearly  the 
context  of  the  initiative,  here  in  Calgary  in  the  human-services,  in  the  1990s,  played  a 
confounding  role  in  the  many  outcomes  of  the  initiative.  The  understanding  of  the  purpose  of 
MOC  continued  to  expand,  initially  among  the  members  of  the  MOC  Committee  and  then 
among  the  participants  at  the  agency  level.  As  the  initiative  progressed  it  became  evident  that 
the  issue  of  barriers  existed  in  other  areas  - such  as  gender,  age,  disability,  religion,  education, 
geographic  region,  and  so  on.  The  working  definition  of  “diversity”  was  expanded  to  include 
these  dimensions. 

The  MOC  Committee,  (chaired  by  Talib  Nanji  and  given  day-to-day  life  by  the  co- 
ordinator, Carole  Holmes),  created  an  Evaluation  Committee  to  develop  a participatory 
evaluation  model.  To  that  end,  the  committee  selected  Philip  Cox  and  his  associates  fi’om 
Plan:Net  Management  and  Consulting  Network,  a local  consulting  organization.  Philip 
Cox  worked  tirelessly  throughout  this  evaluation  to  bring  in  a participatory  evaluation  model  to 
bear  on  the  MOC  project  evaluation.  This  approach  brought  together  stakeholders  with  a 
variety  of  interests  and  perspectives  in  every  phase  of  the  evaluation:  instruments  development, 
data  collection,  data  analysis  as  well  as  report  writing. 
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The  principle  author  of  this  report,  Urmil  (Kitty)  Chugh,  was  a researcher  initially 
hired  by  Plan: Net  to  implement  the  survey  instruments  designed  in  the  spirit  of  the 
participatory  model.  Kitty  analyzed  the  massive  amounts  of  quantitative  and  qualitative  data 
collected  through  these  surveys.  When  Phil  Cox,  the  initial  researcher/consultant,  decided  to 
return  to  school  in  1996,  Kitty  ably  stepped  into  the  lead  role  for  the  final  chapter  of  the  MOC 
evaluation.  Kitty  helped  participants,  often  managers  of  agencies,  see  the  practical  value  of 
basing  decisions  on  the  empirical  data  supported  by  the  research  - as  an  alternative  to 
intuitive,  ‘gut-reaction’  responses  to  issues  in  diversity.  Kitty  feels  she  did  not  do  anything 
earthshaking,  just  her  usual  set  of  tasks  as  a researcher:  collecting,  sorting,  describing, 
documenting,  converging  information  and  interpretation  of  the  survey  results. 

Wendy  Charlton  and  Narmin  Ismail-Teja,  the  training  co-ordinators,  took  over  the  co- 
ordination of  the  MOC  project  in  1995  when  Carol  Holmes  left  the  project.  By  1996  MOC 
had  expanded  considerably  from  the  original  16  agencies  to  approximately  50  agencies  in 
Calgary.  Wendy  and  Narmin  left  the  United  Way  of  Calgary  and  area  to  continue  the  MOC 
work  through  their  Diversity  Learning  Institute  (DLI)  in  1997. 

Niels  Agger-Gupta,  a consultant  with  the  Multiculturalism  Commission/ Alberta 
Community  Development,  was  involved  throughout  the  MOC  process-  on  the  MOC 
Committee,  on  the  Evaluation  Committee  and  other  working  subcommittees,  and  finally,  as 
the  project  officer  and  one  of  the  co-ordinators  of  the  evaluation  itself.  Niels  was  not  involved 
in  the  actual  MOC  training  intervention  with  the  participating  agencies  or  in  the  data  collection 
phases.  Niels  was  concerned  throughout  the  evaluation  with  understanding  how  participants  at 
the  agencies  and  the  United  Way  itself  integrated  their  understandings  of  addressing  Calgary’s 
diversity  with  their  actual  day-to-day  work,  rather  than  seeing  this  as  an  add-on  to  an  already 
overburdened  schedule.  Niels  found  that  the  challenge  of  using  positivistic  research  in  a 
participative,  qualitative  context  led  to  many  significant  intellectual  stretches. 

It  became  evident  that  many  participants  realized  a “paradigm  shift”  during  the  course 
of  their  involvement  with  the  MOC  work,  and  that  many  understandings  of  what  “accessibility” 
was  about,  changed  significantly  between  1992  and  1996.  This  created  significant  challenges 
for  the  evaluation  team,  as  the  nature  of  the  investigation  wais  constantiy  modified.  The 
researchers’  own  growing  understanding  of  the  concept  of  “open”  organizations  both  limited 
and  expanded  the  scope  of  the  study  simultaneously. 

The  document  which  you  are  holding  has  been  made  possible  due  to  the  efforts  of  many 
people,  and  reflects  the  skills  and  personal  journeys  of  countless  stakeholders  in  over  16 
agencies  in  Calgary.  As  a consequence,  this  is  a large  document.  In  fact,  this  document 
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contains  two  independent  documents:  the  Elxecutive  Simmiary  and  the  Final  Report.  The 
two  documents  share  a common  Title,  Acknowledgements,  Preface  and  A Glossary  of  Terms. 

The  Executive  Summary  is  complete  with  the  core  tables  and  appendices,  for  readers 
just  wishing  an  overview  of  the  study.  The  Final  Report  is  divided  into  two  sections.  The  first 
section  describes  in  depth  the  philosophy,  planning,  development  and  implementation  of  the 
United  Way  of  Calgary  and  area  MOC  project.  The  second  section  deals  in  depth  with  the 
impacts  of  the  MOC  project  on  the  internal  and  external  environment  of  the  member  agencies. 
In  the  process  of  analyzing  the  workforce  data  from  both  the  1993  and  1996  applications,  we 
employed  all  three  modes  of  inferential  statistics:  univariate,  bivariate  and  multivariate.  In 
addition,  to  capture  the  essence  and  the  richness  of  the  voices  and  perspectives  of  people  at  the 
agencies  on  the  effectiveness  of  the  MOC  initiative,  we  collected  open-ended  qualitative  data. 

Individuals  who  are  interested  in  the  topics  of  institutional  change  addressing  diversity, 
and  systemic  barriers  and  discrimination,  will  hopefully  find  that  this  report  provides  some 
guidance  in  the  areas  of  policy  development  and  organizational  change  implementation.  The 
report  should  also  be  of  interest  to  those  responsible  for  designing  change  interventions  in  their 
organizations.  This  evaluation  is  not  a critique  of  specific  training  methodologies  and 
interventions,  but  rather,  attempts  to  understand  the  nature  of  the  changes  at  the  participating 
agencies  over  time. 


Urmil  (Kitty)  Chugh 
Niels  Agger-Gupta 
October  29,  1997 


For  more  information  or  to  provide  feedback,  please  contact  the  authors  at 
NAgger@mcdtgOY.ab,ca  , or  call:  403-297-8407 
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MOC’s  Impacts: 

A Description  and  Evaluation  of  the  United  Way  of  Calgary  and  area’s 
Multicultural  Organizational  Change  (MOC)  Initiative 

1991-1996 


A GLOSSARY  OF  KEY  TERMS  AND  CONCEPTS 

The  following  terms  are  used  throughout  the  length  of  this  report.  It  is  essential, 
then,  that  the  readers  become  familiar  with  their  meanings  and  definitions.  The  evaluators 
are  cognizant  of  the  fact  that  some  of  the  meanings  of  concepts  defined  below  (sexist  remarks 
and  racist  remarks)  are  subjective.  For  instance,  people  differ  in  their  assessment  of  whether 
or  not  a remark  is  a racist  remark  or  not. 

■ Attitude  is  way  of  thinking  and  the  resulting  behaviours  which  are  based 
upon  underlying  philosophies  and  assumptions,  many  of  which  are  operating  at 
an  unconscious  level.  These  attitudes  are  based  on  attributions  derived  from 
the  interpretation  from  past  experiences  and  limit  what  is  seen  to  occur  around 
the  individual,  even  on  a factual  lever  (cited  in  Agger-Gupta,  1997,  p.  15). 

■ Backlash  is  “an  angry  group  response  to  what  is  seen  as  a threat  or 
provocation”  (cited  in  Agger-Gupta,  1997,  p.  16). 

■ Barriers  are  “real  and/or  perceived  obstacles  and  problems  which  limit  or 
impede  equal  access  to  and  participation  in  any  service  or  programme  ” (cited 
in  Agger-Gupta,  1997,  p.  17). 

■ Benchmark  “is  a standard  or  point  of  reference  in  measuring  or  judging 
quality  value  etc.  ” (Woolf,  1980,  p.  102). 

■ Benchmarking  “is  the  comparison  of  similar  processes  across  organizations, 
companies  and  industries  to  identify  best  practices  and  set  improvement 
targets.  Companies  benchmark  to  see  where  they  stand  today,  how  they 
actually  spend  their  time  and  add  value.  In  addition,  benchmarking  identifies 
high-potential  improvement  opportunities  and  help  in  scoping  a transformation 
program  and  selling  the  need  for  change.  Benchmarking  also  lets  companies 
learn  what  other  forward-thinking  companies  are  doing  differently  and  better” 
(http : W WWW . cma-canada . org/english/cma67 . html) . 

■ Diversity  is  defined  as  “all  the  ways  we  are  unique  and  different  from  others.  ” 
The  term  describes  the  differences  that  exist  within  Canadian  society,  across  all 
four  levels  of  diversity  - individual,  team/ organizational,  professional  and 
societal”  (cited  in  Agger-Gupta,  1997,  p.  34). 
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Effectiveness  ‘*often,  but  not  necessarily  used  to  refer  to  the  conclusion  of 
goal/ achievement  evaluation,  with  all  its  limitations.  Success  is  roughly 
equivalent  to  this  sense.  Effectiveness  can  be  construed  more  generally  as 
referring  to  achieving  an  outcome... it  always  refers  to  a goal,....  It  is  a means 
and  end  notion'*  (Scriven,  1991  p.  129). 

Efficiency  “goes  beyond  effectiveness  by  bringing  in  a reference  to  the  amount 
of  resources  involved.  It  implies  the  absence  of  wastage  from  inputs  to 
outputs.  To  that  end  efficiency  question(s)  measures  wastage  (or  lack  of  it) 
from  the  input  to  the  outputs”  (Scriven,  1991  p.  129). 

Empowerment  is  “a  feeling  of  capability , self-assurance  and  motivation  to 
access  resources  and  pursue  a goal  to  its  conclusion..  Empowerment  can  be 
self-initiated  or  the  result  of  support  and  attention  on  the  part  of  the  others” 
(cited  in  Agger-Gupta,  1997,  p.  35). 

Equity  is  defined  as  “fairness  and  justice,  especially  the  common  fairness  that 
follows  the  spirit  rather  than  the  letter  of  justice....  Equity  also  involves 
looking  at  power  relationships  between  people  to  flatten  the  playing  field  and 
facilitate  an  equitable  outcome”  (cited  in  Agger-Gupta,  1997,  p.  36). 

Ethnicity/Ethnic  background  is  “the  condition  of  belonging  to  a social  group 
with  a cultural  and  social  system  that  claims,  or  is  accorded,  special  status  on 
the  basis  of  religious,  linguistic,  ancestral  or  physical  characteristics”  (cited  in 
Agger-Gupta,  1997,  p.  36). 

Ethnic  Minority  “refers  to  an  ethnic  group  which  is  represented  by  fewer 
people  than  the  ethnic  majority.  The  term  is  a descriptive  one  and  is  not  used 
to  confer  power  or  lack  of  power,  on  any  particular  ethnic  group”  (Chugh  et 
al.,  1994,  p.  32). 

Impact  is  a “change  in  current  or  established  economic,  demographic  or 
social  condition  that  is  * caused*  by  the  introduction  of  a development  of  some 
kind”  (Chadwick,  Bahr  and  Albrecht,  1984,  p.  239).  In  this  report  the  term  is 
used  synonymously  with  four  other  terms,  difference,  change,  influence  and 
outcome. 

Intervention  “is  [an  act  of  coming  between]  as  an  influencing  force;  to 
modify,  settle  or  hinder  some  action,  argument.  In  the  context  of  diversity,  an 
intervention  is  most  often  thought  of  as  training  of  some  kind,  but,  in  fact  there 
are  many  different  kinds  of  interventions  at  the  different  levels  of  diversity  - 
individuals,  group /team/organizational,  professional,  and  societal”  (cited  in 
Agger-Gupta,  1997,  p.  46). 
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Intolerance  is  defined  as  “unwillingness  to  endure  and/or  lack  of  respect  for  the 
beliefs  and  practices  of  an  individual  or  group  by  another  individual  or  group. 
Racial  intolerance  refers  to  the  unwillingness  to  permit  equal  opportunity  and 
full  societal  participation  to  members  of  racial  groups;  religious  intolerance  is 
the  unwillingness  to  endure  those  of  other  religious  beliefi"  (cited  in  Agger- 
Gupta,  1997,  p.  46). 

5-point  Likert  Scale  is  usually  employed  to  measure  attitudinal  items.  For 
instance  a question  is  asked:  on  a scale  of  1 to  5 how  do  you  agree  (5= “strongly 
agree”  and  1= “strongly  disagree”)  with  the  item  “There  is  commitment  at  the 
top  to  open  the  organization”.  This  attitudinal  variable  is  usually  treated  as  an 
interval  variable.  For  instance,  the  distance  between  1 and  2 is  considered  equal 
to  the  distance  between  3 and  4. 

Paradigm  is  defined  as  “a  scheme  for  understanding  and  explaining  certain 
aspects  of  reality  "(cited  in  Agger-Gupta,  1997,  p.  57). 

Paradigm  Shift  is  defined  as  a “distinctly  new  way  of  thinking  "(cited  in  Agger- 
Gupta,  1997,  p.  57). 

Racist  Remark/Racial  Slur  is  “an  insulting  or  disparaging  statement  directed 
at  a particular  racial  groip"  (cited  in  Agger-Gupta,  1997,  p.  62)  . 

Reverse  Discrimination  is  “the  perception  that  employment  equity  or  political 
correctness  is  causing  members  of  the  traditionally  dominant  cultural  group 
(historically  Euro-Canadians  or  more  specifically  white  Anglo-Saxon  males)  to 
be  discriminated  against.  Often  this  is  a perception  of  opportunity  denied  or  of 
minorities  urf airly  hired  or  promoted  over  more  qualified  white  Canadians" 

(cited  in  Agger-Gupta,  1997,  p.  66). 

Self-identified  Visible  Minorities  are  those  Canadians  who  consider  themselves 
as  belonging  to  visible  minorities.  This  group  can  and  may  include  disabled, 
people  of  colour  and  sometimes  even  homosexual  Canadians.  This  variable  was 
derived  for  this  study  through  the  study  instrument  (from  the  current  evaluation). 

Systemic  Discrimination  is  an  act  (policy  and  practice)  of  intentionally  or,  most 
often  unintentionally,  excluding,  limiting  or  discriminating  against  individuals  not 
part  of  the  dominant  group  in  a social  or  organizational  setting  (adapted  from 
Agger-Gupta,  1997,  p.  71)  . 

Sexist  Remarks/Slur  is  an  insulting  remark  or  disparaging  statement  directed  at  a 
particular  gender.  This  reflects  prejudice  or  discrimination  based  on  sex, 
especially  against  women  (adapted  from  Agger-Gupta,  1997,  p.  68). 
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Variable  is  ''the  phenomenon  that  is  being  studied.  Usually  it  occurs  at 
different  lewis  of  intensity  (or  different  categories)  and  thus  the  label  variable’' 
(Chadwick,  Bahr  and  Albrecht,  1984,  p.  443). 

Visible  Minorities  in  Canada  are  those  people  who  are  not  of  white/European 
or  Caucasian  ancestry.  This  group  is  a subset  of  the  self-identified  visible 
minority  group  in  the  current  evaluation  (adapted  from  Agger-Gupta,  1997,  p. 
81). 
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EXECUTIVE  SUMMARY 


1.0  The  MOC  Project 

In  January,  1990,  the  Board  of  Directors  of  the  United  Way  of  Calgary  and  area 
created  a Task  Force  with  the  mandate  to  ^‘develop  relationships  with  the  ^minority 
communities'  in  order  to  assess  social  service  needs  and  participation  requirements  of 
minority  communities;  increase  opportunities  for  volunteerism;  broaden  the  donor  base  of  the 
United  Way;  and  remove  perceived  or  actual  barriers  to  accessing  United  Way  and  member 
agency  services”. 

By  the  end  of  June  1992,  the  Board  Committee  of  the  United  Way  of  Calgary  and 
area  developed  the  following  vision: 

That  the  United  Way  of  Calgary  and  area  be  a model  for  Multicultural  change, 

reflective  of  the  diversity  of  the  community,  culturally  sensitive  and  free  of 

cultural  barriers.  ” 

This  vision  was  further  translated  into  two  goals: 

1.  To  foster  and  promote  the  full  participation  of  ethnocultural  groups  in  the 
United  Way  by  dismantling  visible  and  invisible  organizational  barriers. 

2.  To  develop  a Catalyst-Connector  role  for  multicultural  change  among  member 
agencies,  non-member  agencies  and  the  diverse  communities. 

The  above  initiative  was  considered  timely  because  the  United  Way  and  many 
segments  of  the  Calgary  community  (e.g.,  women’s  movements  groups,  groups  for  disabled, 
immigrant-serving  organizations)  observed  that  more  and  more  Calgarians  were  “slipping 
through  the  cracks”  and  receiving  inadequate  or  inappropriate  services,  if  any  services  at  all. 
Prior  to  the  MOC  (Multicultural  Organization  Change)  project,  often,  the  provision  of 
services  for  diverse  communities  was  seen  as  an  “extra,”  or  an  “add-on,”  the  costs  of  which 
took  away  from  the  agency’s  “real”  work  in  the  Calgary  community.  Another  common 
concern  at  the  time  was  a perceived  need  for  translating  printed  materials  into  other 
languages.  To  go  a step  further,  in  1991  organizational  change  initiatives  specifically 
targeting  accessibility,  inclusion  and  diversity  issues  were  new  even  to  Canada  as  a whole  in 
1991. 

The  MOC  process  represented  an  opportunity  for  the  United  Way  of  Calgary  and 
area,  the  Alberta  Multiculturalism  Commission,  and  other  funders,  to  learn  about  how  issues 
of  systemic  barriers  could  be  addressed.  Thus,  MOC  became  a new  way  to  understand  and 
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measure  diversity. 

Specifically,  the  MOC  process  operated  in  pursuit  of  two  organizational  change 
outcomes: 

a)  internal  change  - resulting  in  a climate  where  staff  and  volunteers  from 
diverse  backgrounds,  circumstances  and  experiences  can  work  together 
effectively,  and 

b)  external  change  - where  programs  and  services  are  more  accessible  to  a 
wider  range  of  potential  users. 

Ultimately,  between  1992  and  1996  over  40  agencies  in  5 “clusters”  of  agencies  were 
involved  in  the  multicultural  organizational  change  (MOC)  process,  20  trainers  and  over  250 
agency  change  agents  were  trained,  over  3,000  staff  and  volunteers  were  involved  in  the 
MOC  work  at  the  level  of  “clusters”,  individual  agencies,  and  the  United  Way  of  Calgary 
and  area.  Over  75,000  clients  of  participating  agencies  were  impacted  by  the  changes. 
Clusters  were  groupings  of  organizations  that  entered  the  MOC  process  voluntarily. 

Funding  for  the  MOC  project  came  from  the  United  Way  of  Calgary  and  area,  the 
Kahanoff  Foundation,  the  Alberta  Multiculturalism  Commission,  and  Canadian  Heritage 
(Government  of  Canada).  Funding  for  the  evaluation  came  principally  from  the  Government 
of  Alberta,  through  the  Multiculturalism  Commission  and  Alberta  Community  Development, 
Citizenship  Services  Branch,  as  well  as  from  the  Kahanoff  Foundation,  the  United  Way  of 
Calgary  and  area,  and  Canadian  Heritage. 
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Figure  1.  An  Overview  of  MOC’s  Tasks 


The  MOC  Tasks 

1.  To  establish  an  organizational  change  model  to  assist  participating  “mainstream”  agencies  to  adopt  a 
method  for  assessing  barriers  to  access,  and  to  implement  a change  process  that  addresses  the  following 
objectives: 

• (Attain  agency)  conunitment  to  Multicultural  Organizational  Change  [e.g.,  Agency 
orientation  to  "Diversity"  and  MOC  process,  Cluster  Group  Formation] 

• Conduct  Barrier  Analysis: 

-Prepare  Agency  [i.e.  Internal  Change  Team,  Agency  Conununication  Planning] 

-Collect  and  Analyze  Demographic  Profiles  [i.e.,  of  community,  agency  staff  and  volunteers] 
-Conduct  a Systems  Review  and  a Cultural  Audit  [i.e.,  agency  self  examination  of  governance, 
management  systems,  structure  and  organizational  culture] 

-Review  (agency)  documents  [i.e.,  agency  self-examination  of  written  and  visual  materials] 
-Consult  with  Community  [i.e.,  agency  self-examination  of  existing  agency  relationships  and 
reach  in  the  community] 

-Document  Success  Indicators  [i.e.,  keeping  track  of  successes  in  the  change  process] 

-Produce  Final  (agency)  Reports  [i.e.,  identifying  agency  barriers  and  reconunending  ways  of 
dismantling  them] 

• Develop  a Strat^ic  Plan  [i.e.,  integrate  results  of  barrier  analysis  in  agency  planning] 

• Implement  a Strategic  Plan 

2.  To  develop  support  services  for  the  MOC  Process:  (United  Way  MOC  Services) 

• Sustain  Cluster  Work  [i.e..  Admin  Support/Facilitation/ConsultantSupport] 

• Provide  Resources  [i.e..  Resource  Centre,  In-house  Production] 

• Evaluate  Progress  and  Process  [i.e..  Assessment  Tools  & Survey  Instruments] 

• Develop  Training  Team  to  Support  MOC 

• Provide  Partnership  Grants  (United  Way)  to  Facilitate  Collaborative  Programming 


2.0  MOC  Evaluation 

Since  the  inception  of  the  MOC  project  in  1990,  a series  of  formal  and  informal 
research  designs  were  established  to  evaluate  MOC’s  effectiveness  in  its  formation  and 
development  phases.  This  was  an  attempt  to  ensure  smooth  progression/implementation  of 
MOC.  These  step-wise  evaluation  exercises  have  produced  several  documents  which  can  be 
found  at  DLI  (Diversity  Learning  Institute)  ^ This  report  contains  an  account  of  MOC’s 
impacts/outcomes  between  1993  (baseline  assessment)  and  1996  as  reported  by  the  staff  and 
board  of  the  14  agencies  2.  The  Discussion  section  in  the  Complete  Report  (Part  2), 


^ These  can  be  found  in  the  DLI  (Diversity  learning  Institute)  which  is  housed  and  supported 
by  The  United  Way  of  Calgary  and  Area. 

^ The  administration  and  filling  out  of  the  workforce  survey  began  at  the  end  of  1993  and 
continued  till  the  early  1994.  The  evaluators  have  considered  1993  the  year  of  the  baseline  study. 
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however,  does  allude  to  the  other  evaluation  pieces  conducted  before  this  current  piece. 

In  1993  staff  (n=475)  and  volunteers  (n=611)  of  16  agencies  completed  a workforce 
survey  designed  to  build  staff  and  board  attitudinal  and  demographic  profiles  of  their 
consumers.  This  baseline  survey  was  followed  up  by  an  impact  survey  in  1996  to  determine 
attitudinal  and  demographic  changes  in  staff  and  board  and  only  demographic  changes  in 
consumer  populations.  Staff  and  board  of  14  out  of  16  agencies  (two  agencies  declined  to 
take  part  in  the  1996  survey)  participated  in  the  impact  survey  composed  of  the  same  three 
components  as  the  baseline  survey:  staff,  n=258;  board,  n=55.3 

2.1  MOC’s  Impacts  on  Four  Levels 

First  and  foremost,  between  1993  and  1996,  the  organizational  change  process 
affected  the  organization  (i.e.,  structure,  systems,  values  and  skills)  most  prominently,  but 
also  had  a secondary,  or  “ripple”,  effect  on  personal  being  (e.g.,  personal  awareness)  on 
the  staff  and  board,  professional  practices  and  lastly  on  the  consumers/community. 

Content  analysis  of  open-ended  comments  revealed  that  the  majority  of  impacts 
associated  with  MOC  were  positive  on  the  following  four  counts:  a)  organization  (e.g., 
education/awareness,  policy  initiatives),  b)  personal  being  (e.g.,  personal  awareness),  c) 
professional  practices  (e.g.,  services  to  diverse  clients)  and  d)  Calgary’s  health  and  human 
services  (e.g.,  open  agencies) 

Like  any  other  large  and  complex  human  service  project  with  multiple  perspectives 
and  issues,  some  respondents  felt  that  the  MOC  project  had  negative  impacts  or  no  effect  on 
their  organizations,  personal  being,  professional  practice  as  well  as  on  the  community. 

Lastly,  some  respondents  were  ambivalent  about  MOC’s  impacts  on  all  four  counts.  This  is 
not  to  imply  that  same  respondents  were  negative  or  ambivalent  on  all  four  counts.  To 
illustrate  negative  feelings,  some  board  and  staff  were  concerned  about  reverse  discrimination 
against  the  dominant  culture.  This  came  as  a negative  externality  (unintended  outcome)  of 
the  MOC  project.  Some  respondents  openly  questioned  the  lead  role  played  by  the  United 
Way  in  this  process.  Some  agencies  felt  that  the  United  Way  had  conflicting  interests  in 
conducting  the  MOC  project.  This  dilemma  may  have  already  been  mitigated  by  the  advent 


^ These  two  agencies,  however,  did  complete  their  cluster  meetings,  i.e.,  they  had 
completed  their  “exposure”  to  the  MOC  process. 

^ "Content  analysis  involves  systematically  coding  messages  or  information  in  them,  into 
categories  [or  themes]  thus  allowing  quantitative  analysis"  (Chadwick,  Bahr  and  Albrecht,  1984,  p. 
239). 
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of  the  Diversity  Learning  Institute  (DLI)  in  January  1997.  Tables  B-1  to  B-4  (Appendix  B) 
outline  results  of  the  content  analysis.  The  four  tables  outline  positive,  negative,  “no  effect” 
and  ambivalent  themes  along  with  their  sub-themes  (e.g.,  personal  awareness  is  a positive 
sub-theme  in  Table  B-2)  and  their  weighting  (the  proportion  of  comments  made  on  the  issue). 

2.2  MOC’s  Impacts  on  Various  Sub-groups 

MOC  had  differential  impacts  on  various  sub-groups.  The  following  passages 
describe  salient  attitudinal  changes  in  seven  sub-groups  (male,  females,  managers,  non- 
managers, “self-identified  visible  minorities”  - abbreviated  as  the  VM  sub-group,  “other  than 
self-identified  visible  minorities”  - abbreviated  as  the  NVM  sub-group,  and  board  members) 
between  1993  and  1996  One-way  analysis  of  variance  (ANOVA)  was  conducted  to 
determine  attitudinal  changes  between  1993  and  1996  within  each  of  the  seven  sub-groups 
These  changes  are  discussed  with  reference  to  four  attitudinal  constructs/factors  (a  factor  is  a 
constellation  of  variables  which  are  all  related  to  a latent  dimension  or  construct)  resulting 
from  factor  analysis  of  the  22  attitudinal  items  common  to  both  the  1993  and  1996  surveys. 
Figure  2 presents  the  four  factors  extracted  from  the  22  items.  See  Table  B-5  (Appendix  B) 
for  the  items  that  form  the  four  factors/constructs 


^ The  first  six  sub-groups  were  extracted  from  the  staff  respondents  in  both  the  surveys. 
Due  to  a relatively  small  sample  size  the  board  sub-group  was  not  broken  into  further  categories. 

The  two  staff  sub-groups  namely  the  “self  identified  visible  minorities”  and  “other  than  self-identified 
visible  minorities”  were  extracted  from  binary  responses  to  the  following  question  in  both  the 
surveys:  I consider  myself  a visible  minority  m Canada*  — Yes  - No. 

Findings  revealed  that  there  is  a higher  proportion  of  disabled  and  non-white  respondents  in 
the  former  sub-group  compared  to  the  latter  sub-group.  The  complete  report  includes  the 
compositions  of  the  seven  sub-groups  and  the  reasons  for  probing  into  there  experiences  and  attitudes 
in  this  evaluation. 

^ See  the  Complete  report  for  the  scales  employed  to  elicit  responses  to  22  items  in  both 
1993  and  1996.  There  some  minor  differences  in  measurement  between  1993  and  1996  survey. 
However,  for  the  sake  of  comparison  the  evaluators  treated  most  responses  (except  for  2 items)as  if 
they  were  elicited  on  a five-point  agreement  scale. 

^ To  learn  more  about  the  rationale  for  selecting  ANOVA  and  factor  analysis  in  this 
evaluation  and  their  algorithm  refer  to  Norusis,  M.  J.  (1990).  SPSS  Base  System  User’s  Guide. 
Chicago:  SPSS  Inc. 
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Figure  2.  The  Four  Factors  Extracted  From  22  Items 


The  Four  Factors  Solution 
Freedom  to  Speak  up  on  Sensitive  Issues  (7  items) 
Management  Dedication  to  Organizational  Openness  (9  items) 
Bringing  Down  Barriers  to  Hiring/Promoting  (3  items) 
Personal  Dedication  to  Organizational  Openness  (3  items) 


Regarding  Construct  1,  Freedom  to  Speak  up  on  Sensitive  Issues  (7  items),  all  the 
seven  sub-groups  reported  an  increase  in  “racist  remarks”  between  1993  and  1996.  Only 
non-managers,  males  and  NVM  sub-groups  reported  an  increase  in  “sexist  remarks”  during 
the  same  time  period.  The  VM  sub-group  also  saw  an  increase  in  “confusion  about  how  to 
communicate  with  people  who  appear  different”  and  “conflict  when  diversity  issues  are 
raised  in  their  organization”.  Lastly,  the  VM  sub-group  felt  that  their  “co-workers  need  to 
be  more  understanding  of  how  people  in  minority  groups  feel”.  These  findings  suggest  that 
most  of  the  sub-groups  feel  more  free  to  speak  up  on  sensitive  issues.  In  particular,  the  VM 
sub-group  seemed  to  express  signs  of  empowerment.  This  is  an  exciting  step  towards 
embracing  diversity  and  including  all  (at  least  as  many  as  possible)  voices  in  formulating 
organizational  policies  and  future  planning.  The  stakeholders  also  asserted  that  awareness 
and  empowerment  are  just  one  part  of  the  diversity  equation.  Without  concomitant 
management  dedication  and  safe  environment  this  gain  in  freedom  of  speech  could  be  short- 
lived. A stakeholder  in  the  March  19,  1997  meeting  said: 

How  do  we  create  an  environment  where  those  kinds  of  discussions  can  be  had 
in  an  honest  way?  If  you  take  me  half  the  journey,  you're  telling  me  I can 
speak,  have  a voice,  and  Vm  going  to  start  taking  risks  - and  there  is  nobody 
there  to  catch  me  when  I fall  - then  I would  judge  this  as  unethical,  in  my 
opinion. 

Regarding  the  Construct  2,  Management  Dedication  to  Organizational  Openness  (9 
items),  the  VM  sub-group  out  of  the  seven  sub-groups  did  not  report  any  changes  in  the 
construct  between  1993  and  1996.  The  stakeholders  put  forth  several  reasons  to  explain  this 
finding.  All  of  the  reasons  discussed  suggest  that  the  VM  staff  came  to  this  process  (in 
1993)  with  different  issues,  expectations  and  circumstances. 
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Still  speaking  of  the  Construct  Management  Dedication  to  Organizational  Openness,  the 
non-managers  saw  a decrease  in  “commitment  to  change  at  the  top  of  the  organization”  between 
1993  and  1996.  Did  the  energy  required  to  sustain  diversity  initiatives  wane  by  1996?  Do  non- 
mangers and  managers  have  (or  have  to  have)  different  foci  based  on  their  respective  job 
descriptions  and  responsibilities?  Do  managers  have  their  hands  fiill  in  addressing  the  other 
organizational  issues  e.g.,  less  funding,  etc.? 

Regarding  Construct  3,  Bringing  Down  Barriers  to  Hiring/Promoting  (3  items),  in  the 
1996  survey  all  seven  sub-groups,  by  and  large,  renewed  their  commitments  to  Bringing  Down 
Barriers  to  Hiring/Promoting.  The  use  of  the  term  “renewed”  is  deliberate  because  a relatively 
strong  commitment  was  gleaned  even  at  the  baseline  stage  (1993).  In  1996  all  sub-groups  made 
an  even  stronger  statement  that  they  “would  not  have  difficulty  being  supervised  by  and  working 
with  someone  from  a different  ethnic  background,  sexual  orientation  and  opposite  sex”. 
(Statement  in  the  quotes  represents  three  items  in  the  1996  survey.) 

Regarding  Construct  4,  Personal  Dedication  to  Organizational  Openness  (3  items),  none 
of  the  sub-groups  increased  their  Personal  Dedication  to  Organizational  Openness.  The  above 
evidence  can  possibly  be  explained  by  both  or  either  of  two  arguments:  a)  both  the  staff  and  the 
board  are  waiting  to  see  workings  of  the  “hypothetical”  fully  open  organization;  and/or  b) 
notwithstanding  the  above,  diversity  is  only  one  among  several  different  organizational  issues. 
While  the  latter  explanation  probably  depicts  the  state  of  affairs  accurately,  the  former  also  has 
elements  of  truth.  The  question  is:  how  high  a personal  priority  is  required  to  take  action  on 
respecting  and  accepting  organizational  diversity?  This  is  at  best  a question  of  judgement. 

2.3  MOC’s  Impacts  on  The  Organizational  Relationships 
In  the  wake  of  MOC  some  organizational  relationships  have  changed  Evaluators 
revealed  these  changes  by  using  one  way  analysis  of  variance  (ANOVA).  Notably,  in  1996  the 
VM  respondents  showed  signs  of  empowerment.  For  instance,  in  1996,  the  VM  sub-group 
(compared  to  NVM  sub-group)  were  more  free  to  speak  up  on  sensitive  issues,  to  point  out 
deficiencies  in  their  management's  dedication  to  organizational  openness  and  also  placed  a 
higher  “personal  priority  on  openness”. 


Still  on  the  subject  of  relationships,  in  1996,  females  (compared  to  1996  males  as  well  as 
1993  females)  were  significantly  less  inclined  to  work  with  male  supervisors  and  bosses. 


These  are  statistical  relationships  rather  than  human  relationships. 
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Still  on  the  subject  of  relationships,  in  1996,  females  (compared  to  1996  males  as  well 
as  1993  females)  were  significantly  less  inclined  to  work  with  male  supervisors  and  bosses. 
Findings  revealed  that  in  both  1993  and  1996  a lower  proportion  of  female  staff  (21%)  were 
in  management  positions  compared  to  the  male  staff  (35%).  These  statistics  did  not  change 
between  1993  and  1996. 

2.4  Changes  in  the  Participating  Agencies 

Only  nine  out  of  15  participating  agencies  had  adequate  sample  sizes  to  analyze 
agency  specific  data  to  determine  changes  manifested  in  each  agency  in  light  of  the  four 
factors/constructs  Note,  selected  items  in  each  of  the  four  constructs  were  used  to  conduct 
this  analysis. 

For  Construct  1 {Freedom  to  Speak  up  on  Sensitive  Issues),  staff  of  five  agencies  did 
not  witness  any  significant  changes  (neither  increase  nor  decrease)  in  frequency  of  “racist 
and  sexist  remarks”  as  well  “as  treatment  of  their  colleagues  based  on  their  appearances” 
between  1993  and  1996.  Another  two  agencies  reported  an  increase  in  “noticing”  that  their 
“colleagues  are  treated  differently  (unfairly)  based  on  their  appearances  (e.g.,  colour, 
disability)”  between  1993  and  1996.  One  out  of  the  remaining  two  agencies’  data  revealed 
that  their  staff  had  “noticed”  a significant  increase  in  all  of  the  three  events  between  1993 
and  1996.  Lastly,  the  staff  of  the  remaining  agency  reported  an  increased  incidence  of 
“racist  and  sexist  remarks”  in  their  organization. 

For  Construct  2,  staff  of  three  agencies  reported  that  there  were  no  significant 
changes  in  Management  Dedication  to  Organizational  Openness  between  1993  and  1996. 
Another  four  agencies  reported  a significant  increase  in  “staff  training”  between  1993  and 
1996.  One  of  these  four  agencies  also  reported  an  increase  in  “management  priority  on 
openness”  between  1993  and  1996.  Interestingly,  the  remaining  two  agencies  reported  a 
significant  decrease  in  “commitment  to  diversity  at  the  top”  and  the  “management  priority  on 
organizational  openness”. 

For  Construct  3 {Bringing  Down  Barriers  to  Hiring/Promoting),  in  1996  the  staff  of 
all  nine  agencies  confirmed  their  original  beliefs  (revealed  in  the  1993  survey)  that  they 
would  not  have  difficulty  having  a “supervisor  with  a different  ethnic  background  from  their 
own”. 


’ Fourteen  agencies  participated  in  1996  impact  survey.  But  one  agency  had  a tributary 
which  was  treated  as  an  independent  entity  in  this  analysis. 
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For  Construct  4,  none  of  the  nine  agencies’  staff  reported  a significant  change  (neither 
increase  or  decrease)  in  level  of  “personal  priority  on  openness”  between  1993  and  1996. 

2.5  MOC’s  Impacts  on  Board  and  Staff  Demographic  Compositions 

The  available  information  precludes  any  conclusive  comments  on  this  issue  because  of 
low  return  rates  in  both  the  surveys  (less  than  60%  for  staff  and  less  than  30%  for  board  in 
the  1996  survey).  “Eyeballing”  frequency  distributions  of  key  demographic  variables  in  the 
base-line  (1993)  and  the  impact  surveys  (1996)  revealed  no  discemable  changes  in  staff 
board  demographic  compositions:  gender,  level  of  formal  education,  spoken  and/or  written 
languages,  age,  religion,  perceived  visible  minority  status,  and  length  of  time  in  Canada.  It 
is  of  note,  that  there  was  diversity  among  staff  respecting  ethnic  backgrounds,  religions  and 
spoken  and  written  languages.  It  is  difficult  to  state  whether  or  not  the  staff  and  board 
demographic  compositions  reflected  the  community  in  general.  Lastly,  the  majority  (80%)  of 
staff  members  who  participated  in  this  evaluation  were  women  both  in  1993  and  1996. 

Aside  from  the  hard  data,  perhaps  three  years  is  not  long  enough  for  agencies  to  change  their 
staff  compositions.  But  board  members  in  these  agencies  have  a relatively  shorter  stay. 
Therefore,  board  composition  is  a good  indicator  of  organizational  openness. 

2.6  MOC’s  Impacts  on  the  Consumer  Populations 

Lastly,  there  is  some  evidence  of  a change  in  the  consumer  populations.  Board  and 
staff  respondents  reported  that  selected  programs  have  more  diverse  (“somewhat  diverse” 
and  “much  more  diverse”)  consumers  in  1996  compared  to  1993.  Having  said  that,  the 
evaluators  observed  the  struggles  and  energy  these  agencies  had  to  put  up  to  change  their 
programs  and  services.  There  was  a significant  push  for  agencies  to  reassess  their  consumer 
population  and  to  develop  programs  and  services  for  previously  unserved  parts  of  the 
community.  Table  B-6  outlines  why  consumer  populations  are  “more  diverse”,  “the  same” 
or  “less  diverse”  in  1996  compared  to  1993.  Clearly,  there  is  a need  for  agencies  to 
critically  assess  how  their  programs  may  meet  the  needs  of  unserved  communities.  For 
example,  a program  for  teenage  mothers  should  be  accessible  to  all  teenage  mothers 
irrespective  of  their  ethnic  backgrounds,  ability/disability  status  and  so  on. 
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3.0  Implications/Future  Directions  of  the  MOC  Project 

There  were  some  negative  comments  about  the  MOC  process,  but  the  positive 
overwhelmingly  outweighed  the  negative  ones,  prompting  stakeholders  to  search  for  ways  to 
solidify  the  gains  made  by  this  process,  and  continue  MOC  in  some  form. 

By  now  it  is  quite  clear  that  local  context  and  dynamics  are  so  critical  that,  no  single 
or  “canned”  approach  will  work  in  all  organizations.  What  an  organization  thinks  of  as  the 
task  of  “accessibility”  and  how  the  following  questions  are  asked  and  answered,  determine 
the  actions  that  follow,  a)  Is  change  a top-down  or  bottom-up  process,  or  are  both  required? 
b)  Can  organizational  change  be  mandated,  or  should  it  be  voluntary?  c)  Can  people  be 
“made”  to  change?  d)  Do  the  personal  experiences  of  organizational  leaders  lead  to 
attitudinal  changes,  which  then  creates  an  environment  which  helps  the  organization  to 
change?  e)  Should  the  change  effort  focus  on  attitudes,  behaviours,  or  on  skills?  It  is  of 
note  that  these  and  many  similar  questions  are  not  new  to  the  MOC  project.  They  were  first 
raised  at  the  inception  and  planning  stage  of  the  project. 

3.1  Rationale  for  Retaining  the  MOC  Project 

Despite  the  glitches,  problems  and  because  of  differential  impacts,  MOC  left  an 
important  overall  message  that  diversity  initiatives  and  their  evaluation  have  critical  roles  to 
play  in  Calgary’s  human  services  sector.  Human  Service  organizations  at  least  recognize  that 
a significant  part  of  the  question  of  MOC’s  success  has  to  do  with  the  understanding  of 
change  that  different  individuals,  groups  and  organizations  hold.  Organizations  which 
typically  started  out  thinking  the  problem  was  one  of  advertising,  and  that  translating  their 
communications  into  other  languages  would  suffice,  have  begun  to  recognize  the  long-term 
nature  of  the  problems  of  accessibility  for  all.  The  MOC  initiative  clearly  revealed  that 
tinkering  with  “external  optics”  rarely  has  any  more  than  a superficial  effect  because  the 
problem  of  culturally  inappropriate  services  is  much  more  complex. 

The  evaluators  and  the  stakeholders  identified  the  following  key  elements  to  better 
integrate  the  process  into  these  agencies:  goals/philosophy,  training,  policies  for  the 
individual  agencies  and  evaluation  of  the  MOC  project. 

3.2  MOC’s  Philosophy/Goals/Objectives 

None  of  the  concerns  were  about  the  objectives  and  goals  of  MOC:  no  one  disputed 
the  need  for  inclusive  services  and  an  equitable  workplace.  Criticism  did  centre  on  the 
methodology  and  the  philosophical  approach  that  was  employed  in  the  MOC  training 
intervention  for  addressing  diversity  and  exclusion  issues.  Some  comments  reflected  a 
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concern  that  MOC,  contrary  to  its  stated  aim  of  valuing  all  diversity,  did  not  equally  respect 
and  value  the  concerns,  values  and  experience  of  everyone  in  the  agency.  Comments  about 
“reverse  discrimination”  clearly  suggest  some  “mainstream  staff”  and  board  felt  that 
supporting  MOC  would  put  their  “Canadian”  identity  and  privileges  at  risk.  Some  viewed 
the  intervention  negatively  because  MOC  attempted  to  foster  a change  in  the  workplace 
relationships,  a domain  previously  considered  out  of  the  bounds  of  external  intervention. 

The  member  agencies  were  concerned  about  their  autonomy  because  their  funder,  the  United 
Way,  was  at  the  root  of  affecting  these  changes.  Lastly,  there  were  concerns  about  the  time, 
energy  and  resources  that  MOC  required.  The  advent  of  the  Diversity  Learning  Institute 
(DLI)  might  have  already  mitigated  some  negative  feelings  because  the  United  Way  of 
Calgary  and  area  is  no  longer  leading  the  MOC  process. 

3.3  MOC’s  Training 

The  evaluators  did  not  collect  first-hand  or  primary  data  to  determine  the  effectiveness 
of  the  training  team  or  how  the  front  line  trainers  were  selected  for  the  job.  It  was  assumed 
that  trainers  were  selected  on  the  bases  of  the  following  skills  and  knowledge  which: 

a)  reflect  an  analysis  of  power,  privilege  and  oppression,  at  a personal  level 
and  as  it  relates  to  approaches  to  learning. 

b)  demonstrate  self  awareness.  Trainers  who  have  not  dealt  with  the  impact  of 
racism  and  discrimination  in  their  own  lives  may  not  be  qualified  to  be  trainers 
in  this  area. 

To  establish  criteria  for  selecting  trainers  and  then  adhering  to  them  is  paramount  for 
the  success  of  the  MOC  project.  This  point  has  been  raised  here  for  the  sake  of 
completeness.  The  evaluators  are  well  aware  of  the  fact  that  these  principles  were  discussed 
in-depth  during  the  inception  and  planning  phases  of  the  MOC  project. 

3.4  Policy  Initiatives 

The  findings  of  the  evaluation  indicate  that  along  with  support  from  key 
organizational  leaders,  effective  training  teams,  a solid  understanding  of  the  organization’s 
structures,  processes,  culture  and  individual  skills,  the  organization  does  need  to  establish  a 
clear  policy  framework  for  addressing  and  valuing  diversity.  These  policies  have  the  effect 
of  clearly  articulating,  both  internally  and  for  the  external  community,  how  the  organization 
has  “internalized”  its  responsibilities  and  welcomes  and  addresses  diversity  as  an  ongoing 
part  of  its  day  to  day  processes. 
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Allowing  racist  or  sexist  action  to  continue  within  organizations  creates  problems  for 
everyone  in  an  organization,  not  just  those  with  minority  status.  MOC  clearly  has  helped 
build  an  awareness  of  inequity  and  diversity  issues  while  helping  support  learning  by  all. 
Ultimately,  the  organization’s  culture  should  be  able  to  immediately  address  such  incidents 
and  prevent  their  occurrence. 


3.5  MOC’s  Evaluation 

Intervention  and  training  designed  to  affect  organization  behaviours,  attitudes  and 
values  should  undoubtedly  be  evaluated  rigorously  and  regularly.  The  current  evaluation  was 
fraught  with  limited  resources  and  did  not  have  the  luxury  of  using  valid  and  reliable 
instruments.  To  date,  no  evaluators/researchers  have  developed  an  exhaustive  (or  even  a 
comprehensive)  reliable  and  valid  instrument  to  gauge  organizational  diversity  and  its  issues. 
Here  are  a few  guidelines  for  future  evaluators  and  students  of  diversity. 


Draw  stratified  random  samples  to  capture  the  heterogeneity  of  the  universe  or 
the  sampling  frame  accurately. 

Conduct  a pilot  test  to  estimate  the  variance  in  the  population  concerning  key 
variables  (e.g.,  gender,  ethnicity). 

Ensure  high  return  rates  (i.e.,  approximately  75%). 

Generate  short,  reliable  and  valid  instrument(s). 

Develop  more  holistic  and  sensitive  instrument(s).  While  the  four  constructs 
(revealed  through  factor  analysis)  establish  an  important  framework  to  study 
organizational  openness,  there  is  still  a need  to  search  for  more  items/tests  to 
measure  diversity  accurately. 

Develop  success  indicators  which  measure  cross-cultural  successes  of  the 
intervention  rather  than  focussing  on  a success  perceived  by  certain  sub-groups 
and  not  others.  The  Stanford-Binet  IQ  test  generated  in  the  early  20th  century 
is  a prime  example  of  this  kind  of  flaw  in  the  test  instrument.  The  test 
instrument  (measuring  IQ)  itself  was  skewed  towards  the  white  population. 
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■ Develop  more  qualitative  approaches  to  capture  the  essence  of  a diversity 
intervention  e.g.,  “naturalistic  evaluation” 

3.6  MOC’s  Sustainability 

The  Stakeholders  Group,  convened  March  19,  1997,  discussed  ways  in  which  the 
MOC  process  could  be  made  more  sustainable.  They  had  suggestions  for  funders, 
organization  leaders  and  for  the  change  process  itself.  They  suggested  that  funders: 

1.  establish  long-term,  core  funding  for  systemic  change  and  not  make  funding 
dependent  on  short-term  projects; 

2.  target  funding  toward  community  priorities  and  require  evidence  from  applicants 
that  their  agency  policies  support  accessibility; 

3.  develop  funding  and  grant  criteria  that  MOC,  or  similar  systemic  change 
initiatives,  be  focused  on  developing  community  capacities  and  be  based  on  a 
participatory,  community  development  approach;  and 

4.  use  their  influence  at  the  federal  and  provincial  levels,  with  their  colleagues  in 
order  that  diversity  matters  are  seen  as  a concern  in  the  human  services. 


Stakeholders  also  suggested  that  MOC  would  have  a better  chance  of  longer-term 
sustainability  if  agencies: 

1.  were  clear  about  their  motivation  for  undertaking  system  change; 

2.  had  a better  understanding  of  their  training  needs; 

3.  developed  internal  training  capacity  so  that  diversity  skills  remain  in  the 
organization,  rather  than  leaving  when  individual  trainers  left  the  organization  or  the 
process; 

4.  supported  shared  learning  with  others  in  their  sector;  and 

5.  understood  that  evaluation  of  the  system  change  is  critical  to  assess  whether  the 
process  is  actually  making  a difference  to  agency  accessibility. 


“An  approach  that  minimizes... technical  jargon,  prior  technical  knowledge,  statistical 
inference,  the  separation  of  the  observer  from  the  subject,  the  commitment  to  a single  perspective, 
theoretical  structures,  experimental  design,  propositional  knowledge  — sometimes  causes.  Instead 
there  is  a focus  on  the  use  of  metaphor,  analogy,  informal  (but  valid)  inference,  vividness  of 
description,  reasons-explanations,  interactiveness,  meanings,  multiple  (legitimate)  perspectives  [and] 
tacit  knowledge.”  Scriven,  M.  (1991).  Evaluation  Thesaurus  (fourth  edition).  Sage  Publication, 
Newbury  Park,  p.  240. 
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4.0  Conclusions 

The  following  conclusions  emerge  from  observing,  listening  and  analyzing  quantitative 

and  qualitative  data  during  1990  to  1996.  (See  Appendix  E for  the  time-lines  and  key  steps 

during  the  seven  years  of  the  project.) 

■ Two  clear  messages  emerged  from  the  United  Way  of  Calgary  and  area  MOC  initiative: 

1.  Addressing  the  barriers  to  accessing  human  services,  based  on  the  dimensions  of 
diversity  which  exist  within  Calgary,  is  a long-term  and  difficult  undertaking, 
challenging  participants  both  personally  and  organizationally.  The  challenges  are  multi- 
faceted for  developing  inclusive  services  with  the  broader  community  externally,  as  well 
as  for  staff  wanting  their  organizations  to  be  more  open  internally;  and 

2.  Despite  numerous  glitches  and  problems,  and  despite  the  differential  impacts  of  MOC 
on  the  14  participating  agencies  and  the  various  sub-groupings  of  staff  and  board,  the 
Evaluators  found  that  the  MOC  intervention  raised  awareness  that  addressing  diversity  is 
critical  for  Calgary’s  human  services  sector. 

■ In  Calgary  (possibly  in  Canada  as  a whole)  there  is  a need  to  develop  more 
organizational  change  initiatives  similar  to  MOC,  as  well  as  developing  consciousness 
about  the  critical  need  to  address  equity  and  inclusivity  - as  a society,  across  the 
professions  and  individually.  At  the  same  time  the  stakeholders/key  actors  should 
recognize  that  diversity  is  a “public  good”  (i.e.,  diversity  is  good  for  aU)  rather  than  the 
domain  of  a particular  sub-group,  for  instance  visible  minorities.  Thus,  the  means  of  any 
such  change  process  are  the  ends,  and  the  process  needs  to  be  implemented  in  such  a 
way  that  everyone’s  experience  is  accepted  and  respected.  Therefore,  participants  from 
the  mainstream/predominant  sub-group  should  not  come  away  with  feelings  of  reverse 
discrimination. 

■ The  four  constructs  (revealed  through  factor  analysis)  establish  an  important  framework 
to  study  and  measure  organizational  openness.  Freedom  to  speak  up  on  sensitive  issues, 
is  a measure  of  basic  trust  within  the  organization,  while  the  other  three  factors- 
management  dedication  to  organizational  openness,  bringing  down  barriers  to 
hiring/promoting,  and  personal  dedication  to  organizational  openness,  are  key  to  a 
sucessful  MOC  change  process.  However,  since  diversity  is  highly  complex  with  many 
variables  and  local  contexts,  there  is  still  a need  for  more  items/tests  which  measure 
diversity  accurately. 

■ Yes,  it  is  possible  to  evaluate  the  success  of  a project  like  MOC.  But  the  qualitative  or 
quantitative  evaluation  design  must  be  culturally  sensitive  and  objective. 

■ While  this  study  has  established  some  content  and  process  criteria  for  assessing  success  in 
diversity  interventions,  until  there  is  a more  broadly  agreed  upon  list  of  specific 
“benchmarks”  and  standards  for  measuring  diversity  intervention  outcomes,  most 
evaluations  of  diversity  initiatives  will  likely  be  “naturalistic  evaluations”. 
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5.0  APPENDICES 
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The  Participants  in  the  United  Way  MOC  Process: 

1.  The  MOC  Committee  (1991-1996) 

Chair  - Talib  Nanji  (Board  Member) 

Niels  Agger-Gupta,  Maria  Astete,  Barb  Chang,  Judge  Cheryl  Daniel  (Board  Member),  Glynn 
Davis,  Vinay  Dey,  Kathy  Deyell , Pamela  Dos  Ramos,  Linda  Elefante-Thompson,  Michael 
Embaie,  Steffani  Felesld  (Board  Member),  George  Kumi  (1992-1994),  Esther  Lau,  Gerri 
Manyfingers,  Lai  Narang,  Pat  Pardo,  Charanjit  Sanghera,  Yvonne  Stanford,  Rosita  Thorpe, 
Teresa  Woo-Paw,  Elsie  Wuttunee  (Board  Member) 

2.  United  Way  MOC  Staff 

Wendy  Charlton  - Diversity  Facilitator,  MOC  Project  Development  - 1995-1996, 

Training  Team  Co-ordinator  - 1993-94,  Co-Co-ordinator  1994-95; 

Narmin  Ismail-Teja  - Diversity  Facilitator,  MOC  Service  Development  - 1995-1996, 

Training  Team  Co-Co-ordinator  - 1994-1995; 

Carole  Holmes  - Multicultural  Facilitator  - 1991-1995; 

Chris  Montfort  - facilitator  / trainer  / practicum  student  1996; 

Angie  Salvo  - Administrative  Support  - 1996  - 1997; 

Susana  Escobedo  - Administrative  Support  - 1995  - 1996 
Suphala  Rao  - Administrative  Support  - 1994  - 1995; 

Mary  Leung  - Administrative  Support  - 1991  - 1993 

United  Way  Barriers  Analysis  consultant  (1991/92)  - Julia  Melnyk  (Springboard  Consulting) 

3.  MOC  Committee  Catalyst  Connector  Sub-Committee: 

Hilde  Moulding,  Calgary  Family  Service  Bureau, 

Cathy  Van  Bavel,  Distress  Centre/Drug  Centre  (chair), 

Yvonne  Stanford,  YWCA,  Cluster  1 (chair) 

Carol  Oliver,  Coalition  on  Family  Violence/  Cluster  4 

Romina  De  Silva,  Cluster  4 

Barb  Chang,  Technical  Resource  Centre,  Cluster  2 

Teresa  Woo-Paw,  Red  Cross,  Cluster  1 

Carole  Holmes,  MOC  Team 

Wendy  Charlton,  Training  Team, 
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Karen  Whyte,  Training  Team 

Niels  Agger-Gupta,  Alberta  Multiculturalism  Commission 

4.  United  Way  MOC  Training  Team 
Co-ordinator(s)  - Wendy  Charlton,  Narmin  Ismail-Teja 

Participants/Members  - Kathy  Briant,  Richard  Campbell,  Doris  Chabot,  Kathy  Deyell, 
Darcy  Foggo,  Gerard  Halpin,  Lisa  Hari,  Narmin  Ismail-Teja,  George  Kumi, 

Lucretia  Martenet,  Donna  McPhee,  Sara  Mitchell-Banks,  Nomogugu  Mgijima, 

Pat  Pardo-Demiantschuk,  Caroline  Russell-King,  Barbara  Schleifer,  Dawn  Scott, 

Keith  Seel,  Jean  Slick,  Sylvia  Waller,  Teresa  Woo-Paw,  Karen  Whyte,  Niels  Agger- 
Gupta  and  Carole  Holmes 

Train-the-Trainers  (June  1993)  Facilitators  - led  by  Reva  Joshee  (RJ3  Consulting)  and  including 
Norma-Jean  McLaren  (42nd  Street  Consulting),  Cecille  dePasse  and  Julia  Melnyk  (Springboard 
Consulting). 


5.  Participating  MOC  Agencies  and  Clusters: 

5.1  Cluster  One  (formed  May  1992)  - large  agencies  : 

Boy  Scouts  of  Canada  - (Change  Agents/representatives)  - 

John  Piera,  Hugh  Chalmers,  Linda  Maid,  Ray  Gayford; 

Boys  and  Girls  Clubs  of  Calgary  - Myma  Lynder,  Cheryl  Doherty,  Lois  Bladon,  Tim  Veitch, 

Chandrika  Mahadeva; 

Canadian  Mental  Health  - Trish  Cameron,  Elaine  Eskow,  Marg  Osborne; 

Canadian  Red  Cross  - Jean  Slick,  Jackie  Wright,  Corine  Frick,  Teresa  Woo-Paw, 

John  DaSilva-Spence; 

YWCA  - Eva  Friesen,  Yvonne  Stanford,  Rosemary  Lee,  Dorothy  Jones, 

Kerry-Lee  Schultheis,  Marcia  Davis; 

United  Way  of  Calgary  and  area  - Frank  Johnston 

Barriers  Analysis  Consultant  - Rebecca  Chan-Allen  (Delta  Learning  Organization,  Inc.) 


5.2  Cluster  Two  (September  1992)  - (medium  and  small  agencies): 
Calgary  Birth  Control  Association:  Susan  Burrows-  Johnson,  Leslie  Gavel; 
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Epilepsy  Association:  Kathy  Fyfe,  Roxanne  LeBlanc; 

Girl  Guides  of  Canada:  Bev  Wahl,  Patricia  Verburgt; 

Technical  Resource  Centre:  Jim  McLaughlin,  Barb  Chang; 

Volunteer  Centre:  Martha  Parker,  Keith  Seel,  Georgette  Thrasher 

Barriers  Analysis  Consultant  - Margery  Knorr  and  Norma  Farquerson 

5.3  Cluster  Three  (January  1993)  - five  counselling  agencies: 

Calgary  Family  Service  Bureau  - Don  Karst,  Hilde  Moulding; 

Catholic  Family  Service  - Greg  Campbell,  Jean  Leong,  Kathy  Tyndale; 

Distress  Centre/Drug  Centre  - Jeanette  McEachem,  Cathy  Van  Bavel,  Dell  Stephens; 

Jewish  Family  Service  - Hope  Kahane,  Michele  Doctoroff,  Anna  Sternberg; 

Pastoral  Institute-  Robbie  Babins-Wagner,  Lois  Heard. 

Barriers  Analysis  Consultant:  Brian  Hoffart  and  Irene  Hoffart  ( Synergy  Research  Group,  Inc.) 

5.4  Cluster  Four  (summer  1992)  - developed  somewhat  independently  of  the  first  three  - 
co-ordinated  by  Coalition  on  Family  Violence  co-ordinators:  Romina  Da  Silva  & Carol  Oliver; 
and  included: 

Calgary  Immigrant  Aid  Society  - Hadassah  Ksienski; 

Calgary  Immigrant  Womens’  Association  - Linda  Elefante  - Thompson; 

Calgary  Women’s  Emergency  Shelter  - Susan  Gardiner 
Catholic  Immigration  Society  - John  Mungham,  Fairborz  Baiijanian; 

Council  of  Sikh  Organizations  - Charanjit  Sanghera; 

Discovery  House  - Norma  Peters; 

Sheriff  King  Home  (YWCA)  - Fran  Snuth 

Barriers  Analysis  Consultant:  (1993  - funded  separately  by  the  federal  department  of  Canadian 
Heritage)  Julia  Melnyk  (Springboard  Consulting  Inc.) 

(1995)  Margery  Knorr  and  Norma  Farquerson 


5.5  Cluster  Five  (created  in  1995) 

formed  at  the  request  of  agencies  dealing  with  people  in  trouble  with  the  law,  and  included: 
Alberta  Seventh  Step  Society:  Jim  Osborne,  Esther  Jackson; 
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Elizabeth  Fry  Scx:iety:  Michelle  Clarke,  Bev  Frizzell,  Barb  limes,  Deborah  Bartlett; 

John  Howard  Society:  Gordon  Sand,  Ian  Cundliffe,  Gladys  Bolinsld,  Vem  Fielder 

Barrier's  Analysis  Consultant:  Brian  Hoffart  and  Irene  Hoffart  ( Synergy  Research  Group,  Inc.) 

6.  Circles  Process 

6.1  Change  Agents  Circle: 

Pam  Greer;  Gerard  Halpin,  John  DaSilva-Spence  - (Red  Cross) 

Chandrika  Mahadeva,  Teri  Adair,  Monica  Pohomann  - (Boys  & Girls  Clubs) 

Norma  Cody  - (YMCA) 

Nadine  Nesbitt,  Lois  Sutterland  - (Calgary  Legal  Guidance) 

6.2  Leadership  Circle: 

Myma  Linder  - (Boys’  and  Girls’  Clubs) 

Susan  Burrows-Johnson  - (Calgary  Birth  Control  Association) 

Jean  Slick  - (Canadian  Red  Cross) 

Hope  Kahane  - (Jewish  Family  Services) 

Danielle  Aubry  - (Calgary  Communities  Against  Sexual  Abuse  - CASA) 

Ed  Johnston  - (United  Way  of  Calgary  and  area) 

6.3  Facilitators  Circle 
Lois  Bladon;  Chandrika  Mahadev  - (Boys’  and  Girls’  Clubs) 

Suzzanne  Rosebrugh;  Cathy  Van  Bavel  (Ghinescu)  - (Distress  Centre/Drug  Centre) 

Narmin  Ismail-Teja;  Chris  Monfort  - (United  Way  of  Calgary  and  area) 

Romina  Da  Silva  - (Calgary  Coalition  on  Family  Violence) 

Jessica  Ayala;  Marcia  Davis  - (YWCA) 

Pat  Pardo  - (Canadian  Mental  Health  Association) 

Peggy  Bevens  - (Red  Cross) 


6.4  Resource  Circle 

Wendy  Charlton,  Brenda  Aries,  Valerie  Barr,  Christine  Monfort-  (United  Way  of  Calgary  and 
area) 

Angela  Stephen,  Greg  Bielecki,,  Jim  Connolly,  John  Da  Silva  Spence;  Natasha  Chetty  - 
(interested  community  members) 
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Rebecca  Chan  Allen  - (Delta  Learning  Organization) 

Niels  Agger-Gupta  - (Alberta  Multiculturalism  Commission) 


6.5  Quality  Circle 

Colleen  Hauck,  Liza  Choi  - (Canadian  Red  Cross) 

Frank  Johnston  - (United  Way  of  Calgary  and  area) 

Lisa  Chan  - (Calgary  Chinese  Elderly  Citizen  Association) 
Hildie  Houlding  - (Calgary  Family  Service  Bureau) 
Leveme  Campbell  - (YWCA) 

Marva  Ferguson  - (CASA) 


6.  6 Project  Circle 

Wendy  Charlton,  Narmin  Ismail-Teja,  Chris  Monfort,  Susan  Escobedo  - (United  Way  of 
Calgary  and  area) 

Rebecca  Chan  Allen  - (Delta  Learning  Organization) 

7.0  FMicipants  at  the  March  19,  \W1  Stakeholders  Meeting 
held  at  Alberta  Community  Development  - 301  - 11  Avenue  S.W. 

Teresa  Woo-Paw  - (Calgary  Chinese  Community  Service  Association) 

Patricia  Bond,  Frank  Johnston,  Talib  Nanji  - (United  Way  of  Calgary  and  area) 

Wendy  Charlton,  Narmin  Ismail-Teja,  Chris  Monfort  - (Diversity  Learning  Institute) 
Cathy  Keough-Ghinescu  - (Distress  Centre/Drug  Centre) 

Hildie  Houlding  - (Calgary  Family  Service  Bureau) 

Susan  Burrows- Johnson  - (Calgary  Birth  Control  Association) 

Janet  Wager  - (YWCA) 

Amal  Umar  - (Canadian  Heritage  -Government  of  Canada) 

Philip  Cox  - (Plan:Net  2000  Management  & Consulting) 

Urmil  Chugh  - (Independent  Consultant/Evaluator/Researcher  and  also  PlaniNet) 

Niels  Agger-Gupta  - (Alberta  Community  Development/  Evaluator) 
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Appendix  B 

Table  B-1.  MOC's  Effects  On  Participating  Organizations  as  Reported  By  Staff 
and  Board:  Results  of  Analysis 


Theme 

No  of 
Comments 
=148 

• Provided  education/tiaining/awareness  etc.  to  staff  and  board  members 

45  (30%) 

• Impetus  to  remove  barriers  in  service  delivery 

24  (16%) 

• Impenis  to  formalize  diversity  initiatives  e.g.  policy  formulation,  forum  for 

23  (16%) 

discussion  etc. 

• Impetus  to  make  board  and  other  volunteer  composition  more  diverse 

3(2%) 

• Impetus  to  allocate  resources  for  diversity  initiatives 

3(2%) 

• In^etus  to  make  staff  con^osition  more  diverse 

1 (1%) 

99  (67%) 

Examples 

- “The  process  has  invited  people  to  unite  in  working  towards 

one  goal”. 

- “Provides  a forum  for  discussion  and  reflection 

- “Made  us  look  more  closely  at  our  policies  and  be  sensitive  to 

filling  gaps  that  may  exist  as  they  relate  to  accessibility 

- “Freedom  to  ask  questions 

- “Additional  time  available  to  deal  with  the  issues 

• MOC  was  a waste  of  time 

• MOC  process  was  unethical 

6(4%) 

• MOC  promoted  feelings  of  reverse  discrimination 

4(3%) 

2 11%) 

12(8%) 

Examples 

- "MOC  is  a joke.  People  of  top  management  are  all  talk  but 

no  do.” 

- “Just  given  lip  services  and  not  really  committed  to  the 

process.  ” 

- Too  money  stats  [which]  gets  away  from  goal  to  serve  my 

community.  ” 

- “We  must  be  carejul  not  to  lose  sight  of  who  we  are  and  where 

we  came  from.  We  must  not  forsaJa  of  our  majority  only  for 

sake  of  a small  minority.  ” 

(Continued ) 


MOC’s  Description  & Impacts  Page  34 


Table  B-1.  MOC's  Effects  On  Workings  on  Organizations,  Reported  By  Staff 
and  Board:  Results  of  (Cont’d) 


Theme 

No  of  Comments 
=148 

iMiL  onto  Ejfe<^on  ^ Orgmkjeoion 

• Organization  still  the  same  as  before  MOC 

Examples 

- “We  were  an  open  agency  before  the  process.  “ 

- “Our's  is  afar-seeing  agency...  before  FutureWays.  “ 

- “Ihe  agency  has  always  accepted  and  aided  the  so  called 
minorities. " 

22  (15%) 

• MOC  had  or  could  have  had  a positive  effect  on  the  oigaiuzation  BUT  .... 
Examples 

- “When  the  purpose  of  the  agency  is  somewhat  ignored  while 
staff  get  all  caught  up  in  MOC  work...  it  leaves  staff  feeling 
divided,  impotent,  not  good  enough  angry  and  isolated.  ” 

- ‘Management  commitment  has  been  somewhat  lacking 
because  of ...  the  various  other  organizational  and  structural 
challenges  we  have  faced.” 

15  (10%) 
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Table  B>2.  MOC'S  Effects  On  Personal  Being/Lives,  Reported  By  Staff  and  Board: 
Results  of  Content  Analy^ 


Theme 

No  of 
Comments 
=154 

• Knowledge/Understanding/Education 

23  (15%) 

/Learning  etc. 

• Awareness/Validation/Solidification  of  Views 

21  (14%) 

• Creates  OppoiUinities 

20  (13%) 

• Self  Examination/Evaluation 

15  (10%) 

• Positive  Work  Environment 

9(6%) 

• Personal  Growth 

9(6%) 

• Personal  Openness 

5(3%) 

• Tolerance/Acceptance/Respect 

5 13%! 

107  (69%) 

E&msks.; 

- "Happy  to  work  with  people  who  are  comfortable  discussing  and  addressing  diversity 
issues  in  a knowledgable  way.  " 

-"lam  more  aware  of  cultured  differences.  I have  become  more  proud  of  my  ethnic 
background. " 

- "I feel  lucky  to  be  able  to  examine  my  own  privilege  and  racism  in  order  to  change..  " 

- "Easier  to  handle  interpersonal  differences.  " 

- "Better  able  to  deal  with  issue  that  client  brings  to  therapy.  " 

- "I  feel  more  comfortable  counselling  clients  from  other  cultures.  " 

• Feeling  Left  Out/Reverse  Discrimination 

5(3%) 

Example 

- "My  culture  and  background  for  more  than  200  years  is  Canadian.  I would  like  to 
be  recognized  too.  I like  multiculturalism  and  diversity,  but  I would  like  to  be  included 
as  well  and  not  always  giving  up  my  traditions.  " 

• Still  The  Same 

25  (16%) 

Examolefs): 

- "I'm  still  the  same.  " 

- "My  work  has  nothing  to  do  with  MOC ....  Personally,  my  opinions  have  not  been 
inflated  by  the  change.  " 

- "I  have  always  been  able  to  work  with  people  whether  they  had  different  sex 
orientation  or  race.. " 

(Continued) 
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Table  B-2.  MOC'S  Effects  On  Personal  Being/Lives,  Reported  By  Staff  and  Board: 
Results  of  Content  Anatyi^  (Cont’d) 


Theme 

No  of  Comments 
=154 

• MOC  Was  Good  ....BUT 

11  (7%) 

EnmekM-’ 

- “MOC  has  impacted  my  life  and  it  is  difficult  [because]  ...the  agency  has  not 
moved  to  the  same  degree..  “ 

- “Ido  not  believe  in  forcing  an  outside  process  on  an  organization.  “ 
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Table  B-3:  MOC'S  Effects  on  Professional  Practices,  Reported  By  the  Staff: 
Results  of  niiiiiiiiii 


Theme 

No  of  Comments 
=68 

• Increased  services  to  a diverse  consumer  population 

15  (22%) 

• Increase  in  knowledge,  awareness,  deeper  understanding  etc 

14  (21%) 

• In^etus  to  interact  with  other  professionals  ie.  promoted  inter-disciplinarity 

8(12%) 

• Provided  skills  to  change  (or  fine  tune)  professional  practices 

6(9%) 

• Created  more  demand  for  experts  to  practice  in  the  area  of  social 

5(7%) 

services/created  employment  opportunities 

• Provided  inpetus  to  change  educational  institutional  (e.g.,  curriculum) 
regarding  diversity  and  related  topics 

3(4%) 

• Provided  inpetus  to  make  diversity  an  area  to  learn  in  social  work  and 
services 

1(1%) 

• Provided  impetus  to  change  some  apects  of  professional  associations 

Examples 

- 7 feel  that  there  is  a great  number  of...  students  who  will  join  our 
program.  ” 

- “There  are  more  demands  for  professionals  such  as  myself  with 
expertise,  skills  and  language  to  deal  with  other  cultures.  ’ 

- “I  see  changes  in  the  School  of  Social  Worker’s 
curriculum  related  to  diversity.  ASSW  conferences  have 
also  reflected  that.  ” 

- “Interaction  of  agencies  bring  motivation  to  be  aware  and  deal  with 
[diversity]  issues.  “ 

- “Have  changed  the  way  Ido  therapy.  “ 

1 (1%) 

53  (78%) 

• Professional  services  and  education  still  the  same 

Examples 

- “ The  majority  of  clients  are  still  white,  English  speaking 

Canadians.  “ 

- “Minimum  changes  at  professional  levels.  “ 

- “I found  the  professions  have  been  cognizant  of  multicultural  issues 
prior  to  MOC.  “ 

9 (13%) 

mmmmm 

• M(X^  could  have  been  good/positive  ...  BUT 

Examples 

- “My  profession  is  struggling  to  survive.  ” 

- “Less  resources  for  clients,  more  different  problems  to  deal  witit.  “ 

- “ Community  professionals  talk  about . . . funding  not  necessarily 
clients.  “ 

6(9%) 
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Table  B-4.  MOC'S  Effects  On  The  Community-at>Large,  Reported  By  Staff 
and  Board:  Results 


Theme 

No  of 
Comments 
=97 

• Service  agencies  more  open/accessible/decreased  barriers 

21  (22%) 

• More  partnership  and  collaboration  in  the  community 

15(15%) 

• Evidence  of  sensitivity/awareness/education 

8(8%) 

• Hiring  practices 

1(1%) 

Excanples 

45  (46%) 

- “The  message  is  getting  out  and  people  are  seeing  the 
benefits  of  diversity. " 

- “Seen  many  more  offers  of  collaborative  efforts  between 
agencies  and  a great  deal  of  discussion  in  regards  to 
mutually  beneficial  alliances.  ” 

- "More  culturally  sensitive  services  offered.  ” 

- "Hiring  practices  — looking  at  diversity  as  an  advantage  not 
a liability. " 

• Government  pohcy 

2 (2%) 

• Change  in  curriculum/changes  in  other  health  care  system 

1(1%) 

Examples 

3(3%) 

- "Government  policies  dictate  that  minorities  be  served 
equally  with  the  dominant  groups.  " 

- "Ghanges  to  curriculum  at  U of  C social  work  program.  ” 

- "The  biggest  changes  are  in  agencies  outside  of  the 

Futureway  process  e.g.  Health  Authority  and  Alberta  Social 

Services.  It  would  be  presuming  too  much  to  assume  this 
process  has  had  any  major  changes  in  Calgary.” 

(Continued) 
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Table  B-4.  MOC'S  Effects  On  The  Community-at-Large,  Reported  By  Staff 
and  Board:  Results  of  (Cont’d) 


Theme 

No  of 
Comments 
= 97 

ofsfOQ 

• Reduction  of  services/decreased  quality  of  services 

5(5%) 

• All  other  issues  forgotten 

1(1%) 

• MOC  was  not  handled  well 

1(1%) 

Examples 

7(7%) 

- “Vulnerable  people  are  not  receiving  services  previously 
available  to  them.  ” 

- ““See  a lot  of  tmger  among  staff  of  non-profit  agencies 
against  United  vfay. " 

- 1 have  seen  services  cut  rather  them  improve.  " 

- fn  the  process  of  transformation  there  has  been  a reduction 
(overall)  in  the  availability  of  some  sendees.  ” 

• Funding  cut  back 

13  (13%) 

• Lack  of  resources 

14  (14%) 

• Mainstream  thinking 

1(1%) 

• Lack  of  government  policy 

1(1%) 

29  (30%) 

Examples 

- 1 think  funding  cut  backs  has  had  a greater  [negative] 
impact.  ” 

- “All  of  the  cut  backs  seem  to  have  services  less  available 
than  before. " 

- “Mainstream  thinking  still  interferes  with  diversity 
implementation.  “ 

Nmefa  IM^ 

8(8%) 

• Community  still  the  same 

Examples 

- T have  not  seen  the  change  ’’ 

- “Nothing  noticeable  — still  many  barriers  to  clients’’ 

Cm^  Assess 

• Can  not  be  sure  if  MOC  made  any  difference 

5(5%) 
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Table  B-5.  Four  Factors  Extracted  from 
Responses  to  22  Items  in  1996  Survey: 
Results  of  Exploratory 


Factors/Items 


Factor  1 


m 


1 . There  is  confusion  about  how  to  conununicate  with  people 
who  appear  different 

2.  People  are  not  treated  fairly  because  they  appear  different 

3. 1 hear  racist  remarks  in  my  organization 

4.  My  co-workers  need  to  be  more  understanding  of  how  people  in 
minority  groups  feel 

5. 1 hear  sexist  remarks  in  my  organization 

6.  There  is  conflict  when  diversity  issues  are  raised  in  our 
organization 

7.  Clients/consumers  with  specialized  needs  e3q)ect  services  which 
agency  can  not  provide 


M 


1.  There  is  an  overall  plan  to  deal  with  diversity  issues  in  our 
organization. 

2.  How  high  a priority  does  your  management  place  on  increasing 
organizational  opeimess? 

3.  There  is  commitment  to  change  at  the  top  of  the  organization. 

4.  Staff  have  created  an  open  forum  for  discussion. 

5.  There  is  adequate  training  for  staff  to  deal  with  diversity  issues 
and  needs. 

6.  Our  agency  only  thinks  of  mainstream  consumers  when  we 
advertise  our  programs. 

7.  My  organization  provides  quality  services  to  people  of  different 
backgrounds. 

8.  Staff  are  motivated  to  work  together. 

9.  Staff  know  to  whom  they  should  refer  clients/consumers  with 
specialized  needs. 


(Continued) 
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Table  B-5.  Four  Factors  Extracted  from  Responses 
to  22  Items  in  1996  Survey:  Results  of  Exploratory 
Factor  Analysis  (Cont’d) 


Factors/Items 

FumrS 

Brining  Down  Barriers  to 
Hiring/Fromoting 

1 . 1 will  have  difficulty  being  supervised  by  someone  from  an  ethnic 
group  different  from  my  own 

2.  I will  have  difficulty  being  supervised  by  someone  fix>m  the 
opposite  sex 

3. 1 will  have  difficulty  working  with  people  whose  sexual 
orientation  is  different  from  my  own 


Factor  4 

to  Organiztamnd 
i^enmss 

1.  How  high  a priority  do  you  personally  place  in  increasing 
organizational  openness? 

2.  Opaiing  up  the  organization  will  make  my  job  more 
secure. 

3.  I am  too  busy  doing  regular  work  to  deal  with  diversity 

issues. 


Note:  Except  for  items  2 in  the  Factor  2 and  1 in  the  Factor  4,  the  above  items  were  ehcited  on  a five-point  agreement 
scale  (1  = “Strongly  Disagree”  and  5=  “Strongly  Agree”).  The  other  two  items  were  elicited  on  a five-point  priority 
scale  (5  = “Top”,  4=  “High”,  3=  “Medium”,  2=  “Low”and  1=  “Not-at-all”) 
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Table  B-6.  Why  Did  Consumer  Populations  Change  or  Not  Change:  Reasons  Given  by  the  Staff  and  Board  in  1996  Survey 
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Table  B-6.  Why  Did  Consumer  Populations  Change  or  Not  Change:  Reasons  Given  by  the  Staff  and  Board  in  1996  Survey  (ContM) 
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Appendix  C 


Key  Points  in  the  Time  Line  of  the  United  Way  of  Calgary  and  area  MOC  Initiatiye  And 

its  Eyaluation 


1990: 

• United  Way  of  Calgary  identified  the  need  to  be  more  responsive  to  the  broader  community. 
Changing  demographics  led  the  Boards  of  the  United  Way  and  Member  Agencies  to  review 
funding  priorities.  A Multicultural  Task  force  suggested  that  United  Way  needs  to  develop  a 
process  to  address  the  barriers  non-white,  mainstream  Calgarians  may  have  in  accessing  United 
Way  services.  This  process  led  the  United  Way  to  create  a board  committee  to  oversee  a 
multiple  year  pilot  in  multicultural  change.  United  Way  hires  Carole  Holmes  to  co-ordinate  the 
MOC  activities.  The  initial  idea  was  that  United  Way  would  attempt  internal  change  first  and 
then  work  with  member  agencies  with  their  newly-developed  expertise. 

1991: 

• (April)  United  Way’s  Multicultural  Organizational  Change  (MOC)  Board  Committee  struck 
with  a membership  of  2 Board  members,  14  community  members,  and  a Co-ordinator  (Carole 
Holmes).  Chairman  is  United  Way  Board  member,  TaUb  Nanji.  Committee  develops  a vision 
and  mission  and  strategic  plan  for  their  process. 

• (Fall)  MOC  Committee  facilitates  the  United  Way  of  Calgary  internal  assessment  (barriers 
analysis)  of  obstacles  and  other  inappropriate  services  for  clients,  staff  of  the  agency  and 
potential  donors  to  the  organization.  Funding  for  this  is  split  between  Alberta  Multiculturalism 
Commission  and  Canadian  Heritage,  who  each  provide  $10,000  for  the  internal  barriers 
analysis. 

1992: 

• (January)  United  Way  of  Canada  designated  Calgary’s  project  as  one  of  four  model  projects 
(Halifax,  Toronto  and  Vancouver  are  the  others)  which  will  run  for  3 years  (1992-1995).  The 
Kahanoff  Foundation  is  providing  over  half  the  funds  for  Calgary’s  project.  United  Way  has 
committed  to  the  remainder  of  funding  (over  $600,000). 

• (April)  Board  of  the  United  Way  invited  Member  Agencies  to  join  the  Multicultural 
Organizational  Change  process  to  participate  in  a pilot  to  address  multicultural  accessibility 
within  the  not-for-profit  human  services  sector.  16  agencies  agree  to  participate  for  three  years. 

• (March)  A report  on  the  United  Way’s  barriers  analysis.  Enlarging  the  Fabric,  was 
produced  by  the  external  consultant  who  undertook  the  review  with  the  MOC  Committee. 

• (October)  Alberta  Multiculturalism  Commission,  imder  its  Access  mandate,  contracted  with 
United  Way  of  Calgary  for  Year  One  of  a three  year  pilot  initiative  to  demonstrate  and 
document  an  organizational  change  process  addressing  accessibility  and  barriers. 
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1993: 

• 16  participating  agencies  (including  United  Way  itself)  work  in  clusters  and  develop  a vision 
and  implementation  strategies  for  a barriers  analysis  and  systems  review.  Organizational 
baseline  reviews  begin  to  be  organized  and  implemented  in  agencies  in  Clusters  One  and  Two. 

• (Spring)  Evaluators  (PlaniNet  Management  and  Consulting  Network)  and  MOC  Committee 
create  an  Evaluation  Stakeholders’  Group  made  up  of  participating  agencies.  In  March, 
PlaniNet  produced  an  Inception  Report  setting  out  the  framework  of  the  1992-95  evaluation. 

• (Time)  A 20  person  training  team  was  recruited  and  trained  and  intensive  agency  training 
begins. 

• (Summer/Fall)  Baseline  implementation  of  evaluation  surveys,  interviews,  focus  groups 
happening  across  agencies  and  United  Way.  The  Evaluation  components  are  interspersed  with 
the  agency  barrier  analysis.  Workforce  Survey  applied  in  late  fall  and  early  winter  and  finished 
in  early  1994. 


1994: 

• Agencies  are  working  to  complete  Barriers  Assessments  and  begin  strategizing  on  addressing 
their  barriers.  Most  agencies  not  yet  finished  by  end  of  1994. 

• (January!  Evaluators  produce  an  Evaluation  Baseline  Report  and  a Findings  Report 

• (Fall)  Kahanoff  Evaluation  of  MOC  process,  clusters,  MOC  Committee  and  stakeholders 
takes  place. 


1995: 

• (May)  Evaluators  produced  the  MOC  Evaluation  Report,  which  reports  that  MOC  has 
“substantially  achieved  its  goal... After  three  years,  most  participants  conclude,  the  effects  of 
MOC  are  only  now  beginning  to  take  hold.”  This  report  also  wrapped  up  the  Kahanoff 
Foundation’s  participation  in  the  MOC  process  across  Canada.  Besides  generally  finding  the 
MOC  process  to  have  resulted  in  significant  changes,  the  PlaniNet  report  noted  that  the  personal 
influence  and  impact  of  Carole  Holmes,  the  MOC  Co-ordinator,  had  played  a critical  role  in 
advocating  for  MOC  and  for  educating  and  supporting  the  various  participating  agencies  and  key 
individuals  through  what  was  clearly  a difficult  process. 

• United  Way  re-orients  some  of  its  financial  assistance  programs  to  support  partnerships 
between  “mainstream”  agencies  and  “ethnocultural  communities”  to  serve  “new”  communities, 
provide  organizational  development  support  to  vulnerable  groups,  and,  for  the  first  time  in 
Calgary,  provide  support  to  ethnocultural  agencies  engaged  in  social  support  work  (such  as 
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Calgary  Chinese  Community  Service  Association). 

• Agencies  report  feeling  the  impact  of  provincial  constraints  and  cuts  to  the  human  services 
sector  - participating  agencies  request  postponing  the  second  implementation  of  the  workforce 
survey  evaluation  to  1996. 

• Carole  Holmes,  the  United  Way  MOC  Co-ordinator,  leaves  project  in  September,  resulting  in 
a shift  in  MOC’s  direction  and  leadership.  Wendy  Charlton  and  Narmin  Ismail-Teja,  the 
Training  Co-ordinators,  job  share  the  Coordinator’s  position. 


1996: 

• Agency  work  continues  with  an  additional  20  participating  agencies  who  are  working  on 
accessibility  planning,  policy  development  and  training. 

• (February)  Implementation  of  a re-designed  survey  to  test  the  baseline  with  agency  staff. 

• (June/July)  The  Evaluators  provide  workshops  back  to  the  14  participating  agencies  on  the 
outcome  of  the  1996  survey. 


1997: 

• The  Evaluators,  working  with  the  original  1992/93  Evaluation  Stakeholders  Group,  complete 
the  analysis  of  the  comparison  between  the  1996  and  1993  evaluations  and  produce 
an  Executive  Summary  of  the  Evaluation  in  July.  The  final,  complete  document  with  all  the 
data,  findings,  tables,  instruments,  etc.  is  finished  at  the  end  of  November. 
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1.  0 Background  and  Context  of  the  United  Way  of  Calgary  Multicultural 
Organizational  Change  (MOC)  Initiative  (1991-1996) 

1.1  Section  Outline 

This  section  describes  the  Multicultural  Organizational  Change  (MOC)  Initiative  of 
the  United  Way  of  Calgary  and  area  in  Alberta,  Canada  from  conception  in  a Task  Force  in 
1990  to  its  5 year  implementation  period  (1991-1996).  Having  set  out  the  Calgary  context 
and  the  background  to  this  Mnd  of  organizational  intervention,  this  section  then  describes  the 
organization  and  structure  of  MOC.  This  is  followed  by  a description  of  the  underlying 
theories  about  organizational  and  system  change  held  by  the  developers  of  MOC  and  some  of 
the  premises  underlying  the  initiative.  This  section  concludes  with  the  background  and 
rationale  for  the  evaluation  initiative  associated  with  the  MOC  project. 

1.2  Chronology  of  the  MOC  Project 

The  Board  of  Directors  of  the  United  Way  of  Calgary  and  area  created  a Task  Force 
in  January,  1990,  with  the  mandate  to  '"develop  relationships  with  the  'minority  communities' 
in  order  to  assess  social  service  needs  and  participation  requirements  of  minority 
communities;  increase  opportunities  for  volunteerism;  broaden  the  donor  base  of  the  United 
Way;  and  remove  perceived  or  actual  barriers  to  accessing  United  Way  and  member  agency 
services.  " Following  a community  consultation,  the  June  1990  Task  Force  Report 
recommended  creating  a three-year  standing  Board  Committee  at  United  Way  to  work  on 
addressing  biases  within  the  organization,  raising  awareness  of  ethnic  and  cultural  diversity 
matters,  and  then  acting  as  a resource  for  this  work  within  the  United  Way,  its  Funded  (then 
called,  Member)  Agencies,  and  the  broader  community. 

A Board  Committee  was  formed  in  the  spring  of  1991  and  developed  a vision, 
mission  and  a strategy  for  implementing  a change  process  within  United  Way,  as  well  as  a 
new  name,  the  Multicultural  Organizational  Change  (MOC)  Committee.  The  Committee  was 
given  a half-time  staff  support  position  by  the  United  Way.  By  the  end  of  June,  the 
Committee  had  developed  a vision: 

Vision:  that  the  United  Way  of  Calgary  and  area  be  a model  for  Multicultural 
change,  reflective  of  the  diversity  of  the  community,  culturally  sensitive  and  free  of 
cultural  barriers. 
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The  above  vision  was  translated  into  two  goals: 


1.  To  foster  and  promote  the  full  participation  of  ethnocultural  groups  in 
the  United  Way  by  dismantling  visible  and  invisible  organizational 
barriers. 

2.  To  develop  a Catalyst-Connector  role  for  multicultural  change  among 
member  agencies,  non-member  agencies  and  the  diverse  communities. 

The  first  task,  developed  over  the  summer  and  early  fall  of  1991,  was  the  United 
Way’s  own  internal  assessment  of  barriers  and  bias,  which  became  known  as  the  “Barriers 
Analysis.”  The  consultant  chosen  by  the  MOC  committee  in  July  1991,  Julia  Melnyk, 
helped  the  Committee  flesh  out  the  task  of  analyzing  what  the  Committee  described  as, 

""  barriers  to  accessing  services  and  organizational  systems  in  general  that  the  United  Way 
had,  unknowingly,  erected  to  people  with  other  than  mainstream  Calgarian  cultural  values.  ” 
This  “Barriers  Analysis”  process  was  intended  to  provide  a “fresh”  look  at  the  systems  of 
the  organization  and  the  cultural  assumptions  that  were  being  made  as  part  of  the 
organizational  culture  in  vision,  policy  and  program  development,  hiring,  promotion, 
communications,  performance  appraisals,  and  even  such  things  as  the  physical  layout  of 
offices  and  the  symbolism  in  the  United  Way  communication,  graphics  and  printed  materials. 

The  Barriers  Analysis  process  collected  information  through  focus  groups,  interviews 
and  surveys  of  staff,  volunteers  (including  the  MOC  committee  and  Board  members)  and 
members  of  the  broader  community. 

The  completed  report  called.  Enlarging  the  Fabric:  A Multicultural  Barrier 
Analysis  of  the  United  Way  of  Calgary  and  area,  was  presented  by  the  MOC  Committee 
to  the  Board  of  the  United  Way  in  March  of  1992.  The  Board  approved  the  development  of 
a strategic  plan  in  the  areas  of  training  in  MOC,  multicultural  policy  development, 
community  outreach/accessibility  and  communication.  This  strategic  plan,  including  a vision 
statement  and  an  action  plan  addressing  diversity  issues  at  United  Way,  was  developed 
through  a series  of  intensive  United  Way  meetings  involving  both  staff  and  volunteers.  This 
developed  into  a semi-formal  cross-functional  committee,  called  the  Cultural  Change  Team. 

While  the  United  Way  MOC  Committee  was  working  on  its  process  internally,  a 
larger  national  initiative,  sponsored  by  United  Way  of  Canada/Centraide,  and  funded  by  the 
Kahanoff  Foundation,  and,  in  Alberta,  by  the  United  Way  of  Calgary,  and  the  Alberta 
Multiculturalism  Commission,  was  announced  at  the  end  of  1991.  This  new  initiative 
plunged  United  Way  of  Calgary  into  a leadership  role  in  addressing  diversity  matters  with, 
initially,  16  United  Way  funded  agencies  by  May /June  of  1992.  The  key  approach  chosen 
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by  the  MOC  Committee,  once  it  was  clear  that  the  Committee  would  take  a leadership  role 
with  the  larger  initiative,  was  the  development  of  a “cluster”  approach  which  had  agencies 
work  together  in  smaller  groups  of  similar  size  or  function. 

In  the  spring  of  1993,  the  MOC  Committee  developed  a process  for  creating  a MOC 
Training  Team.  The  20  trainers  received  their  initial  train-the-trainer  session  in  June  of 
1993,  and  a process  for  working  with  agency  clusters  and  individual  agencies  was  developed. 
The  MOC  Facilitator,  together  with  the  Barrier  Analysis  consultant,  and  members  of  the 
newly  formed  MOC  Training  Team  began  delivering  agency  training  sessions  in  the  summer 
of  1992  as  a three-day  parallel  track  to  the  Managing  Diversity  Summer  Institute,  sponsored 
by  the  Alberta  Multiculturalism  Commission.  (See  below  for  more  on  the  MOC  process.) 

The  United  Way  chose  a role  as  a participant  in  the  larger  community  process, 
becoming  a participant  in  Cluster  1,  despite  being  about  a year  ahead  of  other  agencies  in 
terms  of  the  change  process,  and  having  already  completed  its  own  Barriers  Analysis.  A 
Year  One  Report,  complete  with  a list  of  accomplishments  in  each  of  the  four  areas  was 
presented  to  and  approved  by  the  Board  in  spring  of  1993.  The  Expected  Outcome  of  the 
Strategic  Plan  was  described  as,  ""The  United  Way  is  an  Organization  of  Choice  for 
Volmteerism  and  Giving  by  all  Calgarians,  including  those  from  Diverse  Communities.  ” 

This  objective  reflected  the  early  perspective  of  some  Board  and  staff  that  the  purpose  of 
MOC  was  to  attract  new  donors  from  the  ethnocultural  communities,  or  for  influencing 
United  Way  funded  agencies. 

Both  large  and  small  Calgary  agencies  were  involved  in  MOC  and,  combined, 
received  over  half  of  the  United  Ways’  $13  million  budget.  (See  Appendix  A for  a listing  of 
all  participating  agencies.) 

Ultimately,  between  1992  and  1996  over  40  agencies  in  5 “clusters”  of  agencies  were 
involved  in  the  multicultural  organizational  change  (MOC)  process,  20  trainers  and  over  250 
agency  change  agents  were  trained,  over  3,(X)0  staff  and  volunteers  were  involved  in  the 
MOC  work  at  the  level  of  “clusters”,  individual  agencies,  and  the  United  Way,  and  over 
75,000  clients  of  participating  agencies  had  been  impacted  by  the  changes. 

Funding  for  the  MOC  project  came  from  the  United  Way  of  Calgary  and  area,  the 
Kahanoff  Foundation,  the  Alberta  Multiculturalism  Commission,  and  Canadian  Heritage 
(Government  of  Canada).  Funding  for  the  evaluation  came  principally  from  the  Government 
of  Alberta,  through  the  Multiculturalism  Commission  and  Alberta  Community  Development, 
Citizenship  Services  Branch,  as  well  as  from  the  Kahanoff  Foundation,  the  United  Way  of 
Calgary  and  area,  and  Canadian  Heritage. 
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1.3  Why  Was  the  MOC  Project  Needed? 

It  seemed  prudent  to  scan  both  the  micro  and  macro  environments  to  determine  how 
diversity  issues  were  being  handled  at  the  time  planning  of  and  before  the  advent  of  MOC. 
The  following  is  an  account  of  the  concerns  and  context  which  help  build  the  case  for  the 
MOC  project  in  Calgary. 


1.3.1  The  Calgary  Context/Issues 

Many  segments  of  the  Calgary  community,  such  as  the  women's  movement,  groups 
for  the  disabled,  immigrant-serving  organizations,  and  ethnocultural  groups,  have  been 
advocating  for  some  time  for  greater  equity  and  diversity  in  the  human  and  social  services 
sector  in  Calgary.  The  common  perception  has  been  that  these  services  were  established  at  a 
time  when  Calgary  was  much  less  diverse,  to  serve  one  particular  cultural  community's 
needs.  The  clear  message  from  the  diverse  communities  is  that  service  agencies  have 
typically  neither  understood  the  needs  and  concerns  of  many  of  the  diverse  communities,  nor 
felt  there  was  any  need  to  change  how  they  operated. 

Often,  the  provision  of  services  for  diverse  communities  was  seen  as  an  “extra,”  or  an 
“add-on,”  the  costs  of  which  took  away  from  the  agency's  “real”  work  in  the  Calgary 
community  in  1991.  Another  common  concern  at  the  time  was  a perceived  need  for 
translating  printed  materials  into  other  languages.  The  expectation  was  that  either  people 
were  not  aware  of  the  agency  services,  in  which  case  translating  brochures  would  attract  new 
clients,  or  that  the  absence  of  clients  from  the  diverse  communities  “proved”  that  they  did  not 
need  the  kinds  of  services  provided  by  the  agency.  Agencies  seemed  to  be  content  to  let 
immigrant-serving  agencies  deal  with  the  needs  of  all  the  diverse  communities  - at  little  cost 
to  themselves.  For  this  reason,  advocacy  groups  have  stated  that  they  viewed  MOC  as  a 
significant  initiative  in  the  campaign  to  bring  about  greater  equity  and  fairness  in  the 
community. 

Calgary  social  services  and  health  non-profit  organizations  vary  in  size,  in  the 
programs  and  services  they  offer,  and  in  their  operating  approach.  They  vary  in  their 
experience  with  and  therefore  understanding  of  and  receptivity  to  addressing  diversity  issues 
in  their  programming  to  the  broader  community.  A key  element  of  the  environmental  context 
for  the  MOC  experience  has  been  the  climate  of  economic  constraints  and  cutbacks  in 
Alberta  and  in  Calgary.  Participating  organizations  are  trying  to  respond  to  larger  needs  by 
more  and  more  groups  who  have  not  been  part  of  the  traditional  client  group  for  agencies  at 
a time  when  there  are  less  resources  to  do  even  existing  tasks.  Many  organizations,  at  least 
initially,  stated  they  were  tom  between  participating  in  a process  they  knew  was  socially 
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right,  and  attending  to  agency  survival  issues.  MOC  initially  was  perceived  by  many 
agencies  as  taking  time  out  to  develop  knowledge  and  skill  in  working  with  new  clients  when 
they  did  not  have  the  resources  to  continue  on  with  old  clients.  Others,  on  the  other  hand, 
saw  that  MOC  possessed  the  ideas,  values,  tools  and  strategies  to  help  confront  the  very 
same  problems,  even  though  it  meant  completely  re-assessing  agency  work,  values  and 
clients. 


1.3.2  The  United  Way  of  Calgary  and  area  Context/Issues 

From  the  perspective  of  the  United  Way,  it  was  becoming  obvious  that  more  and 
more  Calgarians  were  “slipping  through  the  cracks”  and  receiving  inadequate  or 
inappropriate  services,  if  any  services  at  all.  A process  parallel  to  MOC,  called 
FutureWays,  was  begun  in  1990,  with  the  purpose  of  defining  new  funding  priorities  for 
United  Way.  While  not  initially  linked  to  the  ethnocultural  work,  the  resulting  priorities  had 
a significant  degree  of  overlap  with  MOC.  The  FutureWays  priorities  made  reference  to 
issues  of  racism,  systemic  discrimination  and  the  need  for  agencies  to  develop  programs 
having  a strong  consumer/customer  focus.  In  addition,  organizational  change  processes  were 
identified  as  the  primary  approach  for  agencies  to  implement  the  new  priorities.  The  two 
projects  were  merged  as  the  overlaps  between  them  became  evident.  This  also  marked  the 
first  time  that  United  Way  used  community  needs  to  determine  funding  priorities.  The 
United  Way  required  its  agencies  to  submit  three-year  action  plans  identifying  how  they 
intended  to  meet  the  new  priorities.  This  stance  created  some  tensions  between  United  Way 
and  its  Agencies  in  the  early  phases  of  the  MOC  process. 

1.3.3  The  MOC  Project  in  the  Context  of  Diversity  Work  in  Canada  in  1991 

Organizational  change  initiatives  specifically  targeting  accessibility,  inclusion  and 
diversity  issues  were  new  to  Canada,  and  to  Calgary,  in  1991.  Prior  to  this  time,  the 
Canadian  example  of  this  type  of  change  process  was  the  initiative  described  by  Barb 
Thomas  in  her  book,  Multiculturalism  at  Work:  A Guide  to  Organizational  Change, 
(published  by  the  YWCA  of  Metro  Toronto,  1987),  about  the  process  and  outcomes  of  her 
(and  other  consultants’)  work  with  the  YWCA  of  Metro  Toronto  between  1981  and  1986. 
Thomas’s  book,  the  first  case  study  in  Canada  of  this  kind  of  organizational  change, 
developed  both  a theoretical  framework  for  anti-racist/multicultural  change  work  and 
presented  helpful  guides  to  others  involved  in  this  kind  of  process.  A version  of  this  model 
formed  the  core  of  an  initiative  within  the  United  Way  of  Greater  Toronto  between  1986  and 
1991.  The  “Multicultural/ Anti-Racist  Organizational  Development”,  or  M/AROD  initiative 


MOC’s  Description  & Impacts  Page  58 


td  br?l^gM 


ifjiaiiMssr 


«!Pr*  sv-v,  1 *1 

‘'A 


, , m 

A ivtAg 

.>j 


t^& 


li)^i|^-fS^^  ii 


t.  ■ '''  '/sssili-^  '•««&’■.  ■ .. 


M 


p$m 


^rt)  {;#tfif^i  u'ittWT 
'(todj  '•■^/Ort  ^ 


bc^u  r-j(SWf«J 


■M' 


.-S'*-  .«l«.it  mm  "*  ^ «g>w>«  9iaw 

'to  . :*aj4  i«'^i  ;.r<.>du 

.<18P!  (>»■-  'S<>f  uiT^.iri <irittt»T tmsWi to Iw^ 

.0  '‘Vj  i&rjdJBiinesDo  ttoti  ibrlo  i&enfiD  m vJwJ«  ^«w  w ior^ : ' vx  ;w<a  • 
tv  . /!-.o*f  ss-yte  limuii«Wj«i\a»^Jj»  kj»  jhowDforil  l/.>ffiias^  * VvtWav^ 
; '.tiiu  *irt  w r-jrm  tt  ItftW  JiitU  oi  l>'v*ovfl<  Pilio  t>i^ijat)i!^’l»mtaf< . ■'ioanii 

biUi  B8ei  I1■>■^.».l»j  i.i«noT  «'tii"io'  '.o  't«V?  Ijh5|oO  -irtt  Ofhiw  wfjj^inJ  ta\)  mi  »dt  bafl^J 
».'0)t.i,.r-  cr;jifv*V.«  ]D  |l»iii*iit»M,if’'  v“"«S4biA‘j&Bll^^ 


luilrv 


)’f 


’"■J'.',  ‘■Hf. 


i ;*■'•' 


was  described  in  a 1991  publication,  Action,  Access  Diversity!  A Guide  to 
multicultural/anti-racist  organizational  change  for  social  service  agencies  (published  by 
the  United  Way  of  Greater  Toronto,  1991). 

In  1991,  any  process  addressing  diversity  or  inclusiveness,  such  as  MOC,  was  (and,  it 
could  be  argued,  even  in  1997  remains)  new  and  relatively  untested,  with  many  differing 
opinions  as  to  how  best  to  proceed  with  such  a process.  The  MOC  process  was  an 
opportunity  by  the  United  Way  of  Calgary  and  area,  the  Alberta  Multiculturalism 
Commission,  and  other  funders,  to  learn  about  how  issues  of  systemic  barriers  could  be 
addressed.  MOC  became  a test  to  learn. 

1.3.4  Expected  Outcomes  in  Pursuing  the  MOC  Project 

The  MOC  system  change  process  operated  in  pursuit  of  two  organizational  change 
outcomes: 

a)  internal  change  - resulting  in  a climate  where  staff  and  volunteers  from 

diverse  backgrounds,  circumstances  and  experiences  can  work  together 

effectively,  and 

b)  external  change  - where  programs  and  services  are  more  accessible  to  a 

wider  range  of  potential  users. 

See  Appendix  D for  the  Terms  of  Reference  for  the  MOC  initiative  and  evaluation. 

1.3.5  Operating  Assumptions  for  the  MOC  Project 

The  pursuit  of  these  outcomes  rested  on  the  following  assumptions: 

■ systemic  barriers  to  change  within  organizations  are  a result  of  years  of 
ethnocentric  organizational  behaviour,  and  that  an  experiential  process  is 
required  to:  a)  make  barriers  visible,  and  b)  change  policies  and  practices. 

■ creating  internal  and  external  changes  takes  time  and  requires  a cyclical 
process  of  action  and  reflection; 

■ external  change  requires  organizations  to  re-orient  their  internal  management 
to  make  the  new  understandings  a priority  and  to  reward  performance  in  this 
area. 


the  MOC  process  was  a testing,  in  the  Calgary  context,  of  a premise  of 
organizational  change  as  a spiral-shaped,  iterative  process,  as  outlined  by 
Thomas  (1987),  Beckhard  and  Harris  (1987)  and  others  in  the  organizational 
change  field.  The  evaluation  was  to  be  a documentation  of  this.  As  described 
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in  the  literature,  this  change  process  typically  involves  four  stages: 

(Step  1)  developing  a vision  of  what  the  organization  should  look  like; 

(Step  2)  assessing  the  current  situation; 

(Step  3)  planning  and  implementing  an  intervention  in  the  organization 
which  would  move  it  toward  the  vision;  and 

(Step  4)  evaluating  the  outcomes  and  process  after  the  intervention  in 
order  to  reflect,  re-focus,  make  changes  and  then  move  forward  with 
another  iteration  of  Steps  1-4,  and  so  on. 

1.3.6  The  Organization  of  the  MQC  Project 
1.3.6.1  The  MQC  Committee 

The  MOC  project,  co-ordinated  by  the  MOC  Board  Committee,  was  responsible  to 
the  United  Way  Board  of  Directors,  as  well  as  to  the  other  funders  of  the  initiative,  including 
the  Kahanoff  Foundation,  and  the  Government  of  Alberta  through  the  Department  of 
Community  Development  and  the  Alberta  Multiculturalism  Commission,  as  well  as  to  the 
Boards  of  participating  agencies. 

The  MOC  Committee  generated  several  working  committees  - the  Catalyst-Connector 
Sub-Committee  and  the  Training  Sub-Committee. 

The  Catalyst-Connector  Sub-Committee  consisted  of  a representative  from  each  of  the 
clusters  and  two  members  of  the  MOC  Committee.  This  committee  served  as  a linkage  point 
for  the  different  clusters,  who  reported  on  their  various  activities,  and  was  one  of  the  only 
methods  for  sharing  information  with  other  clusters. 

The  Training  Sub-Committee  (1992-93)  developed  the  terms  of  reference,  the 
implementation  and  selection  process  for  the  Training  Team,  which  later  became  United 
Way’s  MOC  Services.  The  Sub-Committee  was  dissolved  when  the  MOC  Training  Team 
was  underway.  This  Team,  merged  with  the  MOC  Facilitator  role  into  MOC  Services  in 
1995/6,  has  now  (1997)  become  an  independent,  not-for-profit  organization,  the  Diversity 
Learning  Institute  (DLI). 
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1.3.6.2  The  MOC  staff  team  (MOC  Services). 

The  MOC  staff  team,  housed  in  the  United  Way,  was  comprised  of  the  full-time 
Coordinator,  an  Administrative  Assistant,  and,  after  fall  1993,  a Training  Coordinator.  The 
Training  Co-ordinator  contracted  with  a number  of  trainers  for  diversity  and  anti-racist 
training  delivery.  The  Coordinator  position,  was  held  by  Carole  Holmes  from  the  creation 
of  the  MOC  Committee  in  1991  until  she  left  the  project  in  September,  1995.  This  position 
was  then  split  in  two.  The  Training  Co-ordinator,  Wendy  Charlton,  then  job-shared  both  the 
MOC  Facilitator  and  Training  Co-ordinator  positions  with  Narmin  Ismail-Teja. 

The  MOC  facilitator  was  responsible  for  the  MOC  Committee  and  the  smooth  running 
of  the  agency  “cluster”  process,  which  was  the  principle  interaction  with  the  agencies. 

Carole,  as  MOC  facilitator,  initially  reported  to  the  Director  of  Community  Services,  and 
then,  in  1992/93,  directly  to  the  President  of  the  United  Way.  During  this  time  Carole  had 
an  adjoining  office  to  President  Ed  Johnston  to  reflect  the  significance  United  Way  placed  on 
MOC.  With  the  re-structuring  of  both  the  MOC  Team  in  1995  and  United  Way 
responsibilities  as  a result  of  organizational  re-structuring,  the  MOC  Co-Facilitators  reported 
to  the  Director  of  Community  Services  at  United  Way  as  well  as  continuing  the 
responsibilities  to  the  MOC  Committee. 

MOC  services  between  1994  and  1996  included  group  facilitation,  co-ordination  and 
administrative  support;  Consultation  (including  the  provision  of  dollars  for  the  purchase  of 
external  consultants  by  United  Way  funded  agencies);  training  across  clusters  and  within 
agencies;  a Resource  Centre;  evaluation  analysis,  tools,  surveys,  demographic  assessment, 
(through  United  Way)  Partnership  Grants  to  help  agencies  develop  working  collaborations 
between  traditional  United  Way  agencies  and  community  groups  serving  ethnospecific  or 
other  marginalized  communities. 

1.3.6.3  Formation  of  Clusters 

Clusters  were  groupings  of  organizations  that  had  volunteered  themselves  to  the  2-3 
year  change  process.  Typically,  senior  managers  and  volunteers  represented  their  agency  in 
the  cluster.  Between  1992  and  1996  there  were  five  clusters.  However,  only  the  first  three 
clusters  participated  in  this  evaluation.  Cluster  One  was  formed  in  May  1992  and  was 
comprised  of  six  large  social  service  agencies,  including  the  United  Way  itself.  Cluster  Two 
was  formed  in  September  of  the  same  year,  and  was  comprised  of  five  medium  and  small 
agencies.  Cluster  Three  was  formed  in  January  1993,  and  was  comprised  of  five  counselling 
agencies.  A fourth  cluster  was  developed  somewhat  independently  of  the  first  three  around 
the  Coalition  on  Family  Violence,  which  included  Calgary’s  women’s  shelters.  A fifth 
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cluster  was  started  in  1995  at  the  request  of  agencies  dealing  with  people  in  trouble  with  the 
law. 

Clusters  continued  to  meet  regularly  and  share  information  up  to  1996.  The  MOC 
Services  team,  with  the  help  of  an  outside  consultant,  Rebecca  Chan-AUen,  then  developed  a 
“Circles”  process  to  provide  support  to  agency  change  agents  on  a number  of  levels.  Circles 
were  established  for  agency  leaders,  facilitators,  support  staff,  change  agents  and  people 
interested  in  resource  development. 

1.3.6.4  Barriers  Analysis  Consultants 

Each  of  the  three  original  clusters  received  MOC  fiinds  to  hire  an  organizational 
change  consultant  to  provide  technical  support  (eg.,  cluster  work  planning,  learning 
materials  development,  group  facilitation,  change  agent  training  and  support,  organizational 
systems  review,  analysis  and  synthesis)  at  the  cluster  level  and  within  each  agency. 
Appendix  A identifies  the  cluster  consultants. 

1.4  The  MOC  Process:  from  Theory  to  Action 

The  outcome  envisioned  was  described  by  MOC  Services  as,  “Effective,  Inclusive, 
Learning  Organizations.”  MOC  Services  and  participating  agency  staff  decided  to  develop  a 
unique,  “leraier”  model  of  Multicultural  Organizational  Change. 

Each  cluster  and  individual  agency  planned  and  used  their  own  tailor-made  strategies. 
MOC  services  were  developed  with  the  clusters  and  were  made  available  to  all  agencies  and 
clusters.  Resources  were  used  in  different  ways  with  vaiying  degrees  of  success,  as  defined 
by  the  agencies  themselves. 

Cluster  agencies,  in  a written  letter  firom  their  Board,  gave  a three  year  commitment 
to  doing  a clear  set  of  tasks.  Participants  in  the  clusters  received  an  initial  orientation  to  and 
subsequent  ttaining  in  the  theory  ^d  practice  of  multicultural  organization^  change.  They 
also  had  access  to  a resource  centre  and  additional  training  from  MOC  Services.  Agency 
leaders  and  the  representatives  to  each  Cluster  agreed  to  the  MOC  Tasks,  as  identified 
below,  but  how  each  of  these  tasks  were  completed  was  left  entirely  to  the  individual  agency 
and  cluster.  Organizational  structures,  cultures,  systems  and  individual  competencies  were 
key  elements  in  how  well  the  MOC  process  worked.  The  MOC  Services  Team  identified 
these  four  areas  as  the  key  elements  of  the  Barriers  Analysis  work. 
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Figure  1.  An  Overview  of  MOC’s  Tasks 


The  MOC  Tasks 

1 . To  establish  an  organizational  change  model  to  assist  participating  “mainstream”  agencies  to 
adopt  a method  for  assessing  barriers  to  access,  and  to  implement  a change  process  that  addresses  the 
following  objectives: 

• (Attain  agency)  commitment  to  Multicultural  Organizational  Change  [e.g.. 

Agency  orientation  to  "Diversity"  and  MOC  process.  Cluster  Group  Formation] 

• Conduct  Barrier  Analysis: 

-Prepare  Agency  [i.e..  Internal  Change  Team,  Agency  Communication  Planning] 
“Collect  and  Analyze  Demographic  Profiles  [i.e.,  of  community,  agency  staff  and 
volunteers] 

-Conduct  a Systems  Review  and  a Cultural  Audit  [i.e.,  agency  self  examination  of 
governance,  management  systems,  structure  and  organizational  culture] 

-Review  (agency)  documents  [i.e.,  agency  self-examination  of  written  and  visual 
materials] 

-Consult  with  Community  [i.e.,  agency  self-examination  of  existing  agency 
relationships  and  reach  in  the  community] 

-Document  Success  Indicators  [i.e.,  keeping  track  of  successes  in  the  change  process] 

-Produce  Final  (agency)  Reports  [i.e.,  identifying  agency  barriers  and  recommending 
ways  of  dismantling  them] 

• Develop  a Strategic  Plan  [i.e.,  integrate  results  of  barrier  analysis  in  agency  planning] 

• Implement  a Strategic  Plan 

2.  To  develop  support  services  for  the  MOC  Process:  (United  Way  MOC  Services) 

• Sustain  Cluster  Work  [i.e..  Admin  Support/Facilitation/Consultant  Support] 

• Provide  R^ources  [i.e.,  Resource  Centre,  In-house  Production] 

• Evaluate  Progr^s  and  Process  [i.e..  Assessment  Tools  & Survey  Instruments] 

• Develop  Training  Team  to  Support  MOC 

• Provide  Partnership  Grants  (United  Way)  to  Facilitate  Collaborative  Programming 


1.5  The  MOC  Outcomes:  from  Understandmg  & Commitment  to  Internalization 

At  the  conclusion  of  the  1996  evaluation,  all  agencies  had  completed  the  Barriers 
Analysis  and  were  in  the  process  of  applying  their  new  knowledge  to  their  agency’s  Action 
Plans.  Many  agencies  continued  MOC  to  the  end  of  1996  as  a formal  initiative,  and  some 
agencies  have,  in  fact,  integrated  the  objectives  of  MOC  into  their  organization  in  ways  that 
reflect  a changed  organizational  culture. 

- The  United  Way  allocated  an  additional  year  of  funding  for  agencies  and  the  MOC  Services 
team,  after  the  conclusion  of  the  Kahanoff  Foundation  funding; 

- The  MOC  Services  developed  a “Circles”  process  to  continue  the  work  of  supporting 
change  agents  in  participating  MOC  agencies; 
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MOC  Services  continued  to  receive  support  from  the  United  Way  to  work  with 
agencies  and  the  broader  community  through  1996. 

As  of  January  1997,  MOC  Services  has  become  an  independent  entity,  a not-for-profit 
organization  called,  the  Diversity  Learning  Institute  (DLI).  A number  of  the  MOC 
Committee  members  have  become  the  Board  of  Directors  of  the  new  organization.  DLI  has 
been  given  continued  support  by  United  Way  and  the  new  Human  Rights,  Citizenship  and 
Multiculturalism  Education  Fund  of  Alberta  Community  Development  (the  successor  to  the 
Alberta  Multiculturalism  Commission). 

Beyond  these  general  comments,  the  outcomes/impacts  of  MOC  are  the  subject  of  this 

Report. 
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2.0  The  MOC  Evaluation 


2.1  Evaluation  Objectives 

The  evaluation  mmed  to  determine  the  effectiveness  of  the  MOC  project  in  light  of  the 
following  two  expected  outcomes: 

a)  internal  chMige  - resulting  in  a climate  where  staff  and  volunteers  from  diverse 
backgrounds,  circumstances  and  experiences  can  work  together  effectively,  and 

b)  external  change  - where  pro^ams  and  services  are  more  accessible  to  a wider 

range  of  potential  users. 

That  is,  the  evaluations  attempted  to  determine  to  what  extent  the  predicted  outcomes  were 
realized.  See  Appendix  D for  the  Terms  of  Reference  for  the  evaluation  of  the  MOC  project. 

2.2  Characteristics  and  Progression  of  the  Evaluation 
2.2.1  Participatory  Approach 

The  evaluators  believed  that  the  evaluation  would  best  serve  the  participants  of  MOC 
if  the  design  and  administration  of  the  insfruments  and  the  coUation  and  analysis  of  the 
information  was  ultimately  owned  and  intemalized  by  the  organizations  and  people  affected 
by  the  findings.  For  this  reason,  the  evaluators  adopted  an  approach  which  was  inclusive 
and  participatory. 


2.2.2  Eyaiiiatiiofl  Stakeholders  Group 

At  the  outset,  tiie  evaluators  convened  a stakeholder  group  comprised  of  funder 
representatives,  Project  staff  and  committee  members,  and  representatives  of  the 
organizations  participating  in  the  MOC  process.  This  group  worked  with  the  evaluators  on 
the  overall  design  of  the  evaluation  research  and  the  formulation  of  the  various  survey 
instruments  in  the  initial  phases  of  the  evaluation  in  1992  and  early  1993.  Members  of  the 
stakeholder  group  disseminated  evaluation  data  for  discussion  within  their  particular  interest 
groups  md  brought  tiie  analysis  back  to  the  evaluators.  Overall,  tiie  group  functioned 
effectively  as  an  intermediary  between  the  evaluators  and  the  participants.  From  the 
evaluators’  point  of  view  the  group  contributed  an  essential  "practical  wisdom"  to  the 
evaluators  understanding  of  tiie  subject  matter.  As  stakeholders  themselves  (i.e.  Project 
staff,  participants  in  Project  activities,  funders),  they  were  able  to  provide  field-level 
“voices”  and  understanding  of  Proj^t  conditions  to  the  shape  of  the  evaluation. 


MOC’s  Description  & Impacts  P^e  65 


>H  ■ ” ' 


.# 


>!«■ 

/S<" 


n»f>.t;  D'-aw  aotla  (jatatefe^i  jsfiw  CE'iiSfi " 


.>f  MA  lo  ttRSO^aftaQ  !»(fi  S««»  tej 
9tii  ia  eirjtte#  feNs  wMkfi^ 

’.■ar,«»R*  wqoaq  ha®  Mjp^i^^»iWs:«'iilB',TO,te«^^  , 
j™ii!j«l^  avfeiibm  SBW^3*d«  /fewrw^aa  wffm  ij^wwr'  “ 


fi  '*’■■  -’1 
JI  ^- ■ '.Iff  A 

- ST'  \<  1 ii}M,i 

tl  -« 


wt)  Vi  itafitmimmtm  &t'.m^ttmi-li9S'' 

Ki  inoaat(!’^'-i  aca-ashr  «|«n!9,.  jiga^iai 

..'  ■•  -fjvTj* ix»hew  *dl "to  ott&dttipai :SMb;;^'ife)i^*S^iH)i»^ 

^ "'  Si*  lo  rudrwM  " 

Ivrstui  imltt-jihaq  tMi}  afatsjw'lMs^wsilb  m iiM 

,•  i,  '■' . hiote^al  (?wi«g'iSi|ito»vO^  ,,lp»«uBfa  !«l»4ils*w»»J  |hKMl^wWIS| 


"i  ■ii, 


^ '4"  ^ ’ 

I ■■ 


^jdf  pacoH  kw  ^,|iav i 

::.^  c4  "moimt^  iaemifntf  ti^mm  tj-  bo4^|i3i^)o  pm  wfitr  % 

ferijif  ' !-£i  o4  ildi  «w  ''■' 

-■\  e»1|  >0  ^ ^ /:, 

ill 

M,  r-;:;l 


This  Evaluation  Stakeholder’s  Group  was  re-constituted  in  March,  1997,  for  a 
meeting  to  discuss  a draft  version  of  a Findings  Report,  produced  by  the  evaluators,  which 
compared  the  results  of  the  1993  and  1996  workforce  and  Board  volunteer  survey 
instruments.  The  quotations  which  appear  in  the  following  Discussion,  Implication  and 
Conclusion  sections  are  taken  from  this  meeting,  which  was  recorded  on  audiotape. 

2.2.3  Stages  in  the  MOC  Evaluation 
There  were  at  least  five  stages  in  the  overall  Evaluation: 

1.  The  first  phase  addressed  the  overall  design  of  the  evaluation 
(see  immediately  below).  The  output  of  this  phase  was  a 
document  entitled,  Inception  Report:  Voluntary  Sector 
Development  Project  (VSDP),  March  1993. 

2.  The  second  phase  focused  on  Baseline  data  gathering.  The 
result  of  this  phase  was  the  VSDP  Evaluation  Baseline  Report 
and  Findings  Reports,  January  1994.  The  agency-specific 
data  in  the  baseline  was  initially  given  to  each  agency  in  written 
form,  then  presented  in  the  form  of  a 2 - 4 hour-  long 
workshop.  This  data  was  then  aggregated  to  produce  the 
Baseline  Report. 

3.  The  third  phase  focused  on  the  state  of  the  MOC  Project  at  the 
end  of  1994  (the  end  of  the  initial  funding  cycle  for  MOC  work 
in  Calgary).  Results  of  this  phase  were  written  up  as  the 
Multicultural  Organizational  Change  Project  (MOC) 

Evaluation  Report,  May  1995.  This  report  is  also  known  as 
the  Kahanoff  Report,  because  it  was  the  conclusion  of  the 
ICahanoff  mvolvement  in  the  evaluation,  but  was  an  evaluation 
update  for  the  Alberta  Multiculturalism  Commission,  United 
Way  of  Calgary  and  ar^,  and  Canadian  Heritage.  The  re- 
application of  the  1993  baseline  was  to  have  taken  place  at  this 
time,  but  agencies  requested  that  the  evaluators  hold  off  for  one 
year  with  this  due  to  overwhelming  stress  levels  at  the  agencies. 

1995  was  when  most  human  service  agencies  were  reeling  from 
provincial  and  municipal  cutbacks.  The  evaluators  agreed  that 
the  re-application  would  take  place  in  early  1996  instead. 

4.  The  fourth  phase  was  the  redesign  and  then  administration  of  the 
workforce  survey  looking  at  agency  demographics  as  well  as 
perceptions  about  diversity  in  the  worlqplace.  This  data,  as  in 
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1994  with  the  1993  data,  was  initially  workshopped  back  to  the 
individual  agencies  in  2-3  hour-long  workshops,  and  then 
aggregated  for  further  study.  After  the  agency  workshops  in  the 
summer  of  1996,  the  data  had  not  been  compared,  except 
superficially,  with  the  1993  data.  This  remained  for  the  final 
phase  of  this  evaluation. 

5.  Environmental  changes,  including  the  re-structuring  of  the 

principle  funder  of  the  evaluation,  the  Alberta  Multiculturalism 
Commission,  and  a re-alignment  of  the  Evaluation  Team, 
delayed  the  process  to  complete  this  report  until  early  1997. 

The  Evaluation  Stakeholders  group  was  re-convened  for  a 
March,  1997  meeting  to  review  the  Findings  of  the  1993/96 
comparisons.  The  1996  data,  complete  with  additional  questions 
assessing  the  success  of  the  MOC  initiative  in  different 
dimensions,  have  now  been  compared  in  different  ways  to  the 
1993  data.  This  comparison  forms  the  core  of  this  current 
document,  and  provides  an  impact  assessment  of  organizational 
change  from  1993  to  1996  as  perceived  by  agency  staff  and 
board  volunteers. 

The  earlier  documents,  describing  the  organizational  change  process  and  its  evaluation 
in  more  detail  than  is  possible  here,  are  housed  with  the  Diversity  Learning  Institute  (the 
former  MOC  Services  Team  at  the  United  Way  of  Calgary)  and  at  Alberta  Community 
Development,  Citizenship  Services  Branch  (the  former  Alberta  Multiculturalism  Commission) 
in  their  Calgary  office.  A compilation  of  all  the  survey  tools  used  in  the  evaluation  process 
is  also  expected  to  be  available  from  both  offices  in  1997. 

2.3  Assessing  the  Impacts 
2.3.1  Methods 

The  MOC’s  impacts  on  the  participating  agencies  (both  on  attitudes  and 
demographics)  were  measured  between  1993  and  1996  by  means  of  a Workforce  Survey 
questionnaire  (see  Appendix  B).  Research  activities  (e.g.,  administering  the  instrument,  data 
collection,  data  coding)  surrounding  the  two  surveys  (baseline  and  impact)  were  essentially 
the  same.  In  this  section  the  evaluators  have  focused  on  the  activities  related  to  the  1996 
survey  along  with  some  salient  differences  between  the  1993  and  1996  surveys.  The 
following  passages  discuss  the  nine  impact  questions,  the  nature  of  both  the  instruments. 
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sample  selection,  data  collection  and  analysis. 


2.3. 1.1  Impact  Questions 

The  following  nine  impact  questions  were  posed  to  determine  MOC’s  impacts.  These 
questions  flow  directly  from  the  evaluation  objectives  (see  Section  2.1). 

1 . How  did  the  MOC  project  influence  changes  in  the  internal  workings  of 
organizations  in  relating  to  diversity  issues? 

2.  How  did  the  MOC  project  influence  personal  changes  in  board  and  staff 
members  in  relating  to  diversity  issues  (i.e.,  have  key  actors  acquired 
furtlier  knowledge,  skills  and  comfort  in  dealing  with  diversity  issues)? 

3.  How  did  the  MOC  project  influence  professional  changes  in  staff 
members  in  relating  to  diversity  issues? 

4.  Did  the  MOC  project  contribute  to  a change  in  programs  and  services 
in  the  social  service  and  health  sector  in  Calgary?  (e.g.,  are  more 
diverse  people  accessing  health  and  social  services?) 

5.  How  have  the  attitudes  of  selected  sub-groups  changed  between  1993 
and  1996  in  relating  to  diversity  issues  (e.g.,  how  have  males  changed 
their  attitudes  towards  diversity  or  how  have  managers  changed  their 
attitudes  towards  diversity  between  1993  and  1996)? 

6.  What  is  the  change  in  the  relationship  between  selected  pairs  of  sub- 
groups in  dealing  with  diversity  issues  between  1993  and  1996  (e.g.,  is 
there  a change  in  how  males  and  females  or  managers/non-managers 
relate  to  each  other  in  1996  compared  to  1993)? 

7.  How  have  the  fourteen  agencies  changed  between  1993  and  1996? 

8.  Did  the  MOC  project  influence  participating  agencies  to  diversify  their 
staff  and  board  members? 

9.  Did  the  MOC  project  influence  participating  agencies  to  diversify  their 
consumers/client  (are  more  diverse  clients  accessing  the  services 
offered  by  the  agencies)? 
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2.3.1.2  Samples 

In  1996  staff  and  board  samples  were  drawn  from  14  out  of  16  agencies  which 
participated  in  the  baseline  study  in  order  to  determine  the  nature  of  impact/change  produced 
by  the  MOC  Project.  Two  out  of  16  agencies  which  participated  in  the  1993  base  line 
survey  declined  to  participate  in  the  1996  impact  survey.  In  the  1993  survey  samples  of 
volunteers  from  16  agencies  were  drawn  from  sampling  frames  which  included  all  volunteers 
irrespective  of  their  function  within  their  respective  agencies.  But  in  1996  only  the  board 
members  were  invited  to  participate  in  the  study.  Two  main  reasons  for  inviting  only  the 
board  members  and  excluding  other  volunteers  in  this  phase  of  the  study  were:  a)  volunteer 
response  rates  were  very  low  in  1993;  b)  depleting  research  resources  made  it  impossible  for 
the  evaluators  to  invite  over  6,000  volunteers  associated  with  these  agencies  to  participate. 
However,  staff  samples  (for  small  agencies  the  whole  of  the  staff)  from  the  16  agencies  were 
invited  to  complete  both  the  surveys.  For  the  sake  of  confidentiality  and  anonymity  the 
evaluators  did  not  maintain  a list  of  1993  respondents  (either  staff  or  volunteers).  However, 
through  responses  to  question  2b,  Part  1 of  the  1996  questionnaire  (Appendix  B),  the 
evaluators  estimate  that  157  (58%)  staff  respondents  who  completed  the  1996  questionnaire 
also  completed  the  1993  survey. 

2.3.1.3  Workforce  Survey  Instnunente 

Unlike  1993,  a single  standardized  version  of  the  workforce  survey  questionnaire  was 
generated  for  both  staff  and  board.  Like  its  predecessor,  the  1996  survey  was  divided  into 
two  broad  sections.  However,  the  length  of  the  instrument  in  1996  was  considerably  shorter 
than  in  1993.  In  addition,  the  instrument  included  four  new  questions  to  specifically 
measure  the  degree  and  quality  of  organizational  change  between  1993  and  1996.  Overall, 
the  questionnaire  was  designed  to  measure  change  and  paradigm  shifts  between  1993  and 
1996,  rather  than  comparing  item-to-item  frequency  distributions  of  the  responses 
(see  Appendix  B).  The  design  of  the  survey  instrument  was  also  inspired  by  Simon  (1990), 
Thomas  (1987). 

Part  One  of  the  questionnaire  (see  Appendix  B)  was  divided  into  four  distinct  sections 
as  follows: 

■ Section  A:  Two  questions  gathered  information  on  the  perceived  self  and 

management  priority  concerning  organizational  openness.  Information  was  elicited 
on  a five-point  Likert  type  priori  scale:  "Top”,  "High",  "Medium",  "Low",  "Not-at- 
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■ Section  B:  This  section  asked  the  respondents  to  focus  on  one  particular  program  and 
service  of  their  choice.  The  respondents  were  then  asked  to  provide  consumer 
profiles  of  the  programs  and  services  based  on  nine  diversity-related  variables  of  the 
program  and  service  chosen:  age  distributions,  gender  distributions,  income 
distributions,  family  makeup,  ability/disability  distribution,  first  language 
distribution,  race/ethnicity  distribution,  sexual  orientation  distribution,  and 
religion/spirituality  distribution.  Next  the  respondents  were  asked  to  make  a 
subjective  assessment  on  whether  or  not  1996  profiles  were  more  or  less  diverse 
compared  with  1993.  Also,  respondents  were  asked  to  provide  reasons  behind  their 
response.  This  section  provided  the  evaluators  insights  into  consumer  profiles  as 
reported  by  staff  and  boards  of  the  participating  agencies 

■ Section  C:  This  section  was  composed  of  23  items  which  individually  and 
collectively  elicited  staff  and  board  member  perceptions  about  diversity.  The 
information  was  collected  by  means  of  a five-point  Likert-type  agreement  scale 
ranging  from  “strongly  disagree"  to  “strongly  agree”. 

■ Section  D:  This  section  elicited  perceptual  information  on  MOC's  effects  on  the 
organization,  respondents’  personal  and  professional  life  and  the  community-at-large. 
To  determine  organizational  and  personal  effect,  two  different  10-point  scales  were 
employed.  The  first  scale  measured  the  degree  of  difference  ("lot  of  difference  to  no 
difference"),  while  the  second  measured  the  quality  of  difference  ("good  to  bad 
difference").  Respondents  were  also  asked  to  provide  open-ended  responses 
explaining  their  answer.  To  determine  the  effect  on  profession  and  community-at- 
large  only  the  degree  of  difference  was  determined,  i.e.,  the  scale  used  was  "lot  of 
difference  to  no  difference".  Similarly  two  open-ended  questions  elicited  information 
concerning  the  reasons  for  the  responses. 

Part  two  of  the  questionnaire  was  composed  of  13  discreet  questions  including  binary 
questions  (yes/no)  and  multiple  response  lists  (i.e.,  check  all  that  apply).  This  section 
elicited  important  demographic  data  including  the  respondent’s  role  in  the  organization. 


The  large  number  of  non-responses  and  “do  not  know”  responses  to  questions  1 and  2a,  Section 
B (Appendix  B)  precluded  any  meaningful  analysis  of  the  results  in  this  section. 
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length  of  time  in  the  organization,  gender,  age,  language  use,  level  of  formal  education, 
religion/spirituality,  perceived  disability  status,  place  of  birth,  ethnic  or  cultural  background 
and  personal  annual  income.  In  the  1996  questionnaire,  the  evaluators  excluded  questions 
regarding  "household  composition"  and  specific  forms  of  disabilities. 

In  summary,  then,  there  were  25  attitudinal  items  (2  items  in  Section  A and  23  items 
in  Section  C)  in  the  1996  survey  compared  to  over  90  items  in  the  1993  survey.  Figure  2 
presents  the  22  attitudinal  items  common  to  both  the  surveys  and  how  they  were  measured. 
The  demographic  component  of  the  two  surveys  was  quite  similar  with  minor  excq)tions 
indicated  above. 


MOC’s  Description  & Impacts 


Figure  2.  Twenty-two  Attitudinal  Items  Employed  to  Assess  MOC’s  Impacts 


Itan 

How  Measured 
in  1993 

How  Measured 
in  1996 

1.  How  high  a priority  do^  your  m^sagemait 
place  on  increasing  iirganiy-atiiinal  opoiness? 

Five  point  “priority  scale” 

Five  point  “priority  scale” 

2.  How  high  a priority  do  you  place  on  increasmg 

organizational  opeon^? 

Five  point  “priority  scale” 

Five  point  “priority  scale” 

3.  My  oi^ankation  provides  quality  serrices  to 
people  of  diHermt  backgrounds 

Five  pomt  “agreanait  scale” 

Five  point  “agreanmt  scale” 

4.  There  is  conffict  whm  diversity  issues  are 
raised  in  our  organkation 

Five  point  “agre^ent  scale” 

Five  point  “agreanmt  scale” 

5.  Staff  have  created  an  op«i  forum  for 
discussion 

Five  point  “agreemait  scale” 

Five  point  “agremimt  scale” 

6.  There  is  an  oreral  plan  to  deal  with  diversity 
issues  in  our  organkabon 

Five  point  “agreanmt  scale” 

Five  point  “agreanmt  scale” 

7.  I hear  sedst  r^arks  in  my  organization 

Five  pomt  “frequaicy  scale” 

Five  point  “agreanmt  scale” 

8.1  hear  racist  raaaariis  in  my  organization 

Five  point  “frequency  scale” 

Five  point  “agreemmt  sc^e” 

9. There  is  conftirion  about  how  to  communicate 
widi  people  who  appear  dffiermt 

Five  point  “frequency  scale” 

Five  point  “agreemmt  scale” 

10.  People  are  not  treated  fairly  because  they 
appear  different 

Five  point  “frequency  scale” 

Five  point  “agreanmt  scale” 

11.  Staff  are  motivated  to  work  togetiier 

Five  point  “frequmcy  scale” 

Five  point  “agreemmt  scale” 

12.  Staff  Imow  to  whom  they  should  refer 
cMmts/consumers  with  spmiilized  ne^ 

Five  point  “frequmcy  scale” 

Five  point  “agreemait  scale” 

13.  CUaits/consumers  with  spedalz^  needs 
expect  service  ftat  agency  can  not  provide 

Five  point  “fr^uaicy  scale” 

Five  point  “agreemmt  scale” 

14.  Out  ag^cy  only  thinks  of  “mainstream” 
consumer  whMi  we  advertise  our  programs 

Five  point  “frequency  scale” 

Five  point  “agreanmt  scale” 

15.  There  is  adequate  trainiM  for  staff  to  deal 
with  diversity  issues  and  nee® 

Five  point”frequmcy  scale” 

Five  point  “agreanmt  scale” 

16. 1 wiH  have  difficulty  bang  surorvised  by 
someone  from  an  ethnic  group  differeat  from  my 
own. 

Five  point  “agreanent  scale” 

Five  point  “agreemmt  scale” 

17. 1 wfll  have  difficulty  bang  supervised  by 
someone  from  the  opporite  sex 

Five  point  “agreanait  scale” 

Five  point  “agreemmt  scale” 

IS.  Oprai^  up  the  organization  wiH  make  my 
job  secure 

Five  pomt  “agreanait  scale” 

Five  point  “agreemmt  scale” 

19. 1 wiU  have  difficidty  worUng  mth  people 
whose  sanial  orieatation  is  differmt  from  my 
own 

Five  pomt  “agreement  scale” 

Five  point  “agreanmt  scale” 

20.  I am  too  busy  doii^  my  regular  work  to  deal 
with  organizational  opam^ 

Five  point  “agreanmt  scale” 

Five  point  “agreanmt  scale” 

21.  There  is  commitmmt  to  change  at  the  “top” 
(e.g.  policy  levd,  sauor  manag«iait)  of  the 
organization. 

Five  point  “agreanait  scale” 

Five  point  “agreanmt  scale” 

22.  My  co-workers  need  to  be  more 
understmiding  of  how  minority  groups  feel. 

Five  pont  “agreanmt  scale” 

Five  point  “agreemmt  scale” 
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2.3.1.4  Data  Collection  And  Ethical  Considerations 

Data  were  collected  by  means  of  the  self-administered  mail-out  questionnaire  along 
with  the  Cover  Letter  (Appendix  B).  Among  other  things  the  the  note  addresses  the 
following:  a)  purpose  of  the  evaluation,  b)  approximate  time  to  complete  the  survey,  c) 
confidentiality  and  anonymity  of  respondents  and  their  responses,  d)  the  voluntary  nature  of 
the  participation  (e.g.,  a choice  not  to  answer  any  question  for  any  reason).  The  letter  in 
Appendix  B was  generated  as  a generic  letter.  Each  agency  revised  the  above  letter  for  their 
own  purposes  and  further  reinforced  the  voluntary  nature  of  the  participation  and  the  right  to 
withdraw  at  any  point  in  the  study.  Finally  the  questionnaire  was  reviewed  informally  by  the 
Alberta  Human  Rights  Commission.  It  was  considered  informal  because  the  Commission 
indicated  that  the  questions  in  the  survey  did  not  contravene  any  human  rights.  However, 
the  Commission  did  not  have  the  mandate  to  provide  a formal  certificate  for  the  review. 

The  baseline  survey  was  administered  between  the  end  of  1993  and  the  begining  of 
1994.  However,  for  all  practical  purpose  1993  was  considered  the  year  of  the  baseline 
assessment.  The  impact  survey  was  administered  between  June  to  July  of  1996.  Thus,  in 
this  report  1993  and  1996  are  reported  as  time  of  the  baseline  and  and  the  impact  surveys 
respectively. 

The  evaluators  supplied  appropriate  numbers  of  questionnaires  to  the  person(s)  in 
charge  of  the  evaluation  distribution  within  individual  agencies.  Those  people  then  mailed 
and  or  distributed  the  questionnaire  to  the  prospective  staff  and  volunteer  respondents.  Upon 
completion  the  respondents  either  mailed  their  questionnaires  directly  to  the  Plan: Net  office 
or  placed  them  in  a box  located  in  their  own  agency.  In  either  case  the  confidentiality  of  the 
respondent  and  the  agency  was  protected.  Ultimately  258  staff  and  55  board  members 
completed  the  questionnaires. 

2.3.1.5  Data  Coding 

The  1996  instrument  employed  four  distinct  scales  compared  to  six  different  scales 
employed  in  the  1993  baseline  survey:  Likert  type  5-point  “agreement  scale”,  likert  5-point 
“priority  scale”  and  10-point  “difference  scale”  designed  to  measure  “degree  and  quality  of 
difference”  made  by  the  MOC  project  on  the  respondents’  agency,  personal  being, 
professions  and  the  community. 

Responses  to  questions  elicited  on  various  scales  (regardless  of  the  number  of  points 
and  the  nature  of  the  scale)  were  assigned  numerical  scores.  For  instance,  information 
collected  on  a five-point  agreement  scale  were  coded  as  follows:  1 = "strongly  disagree",  2 
= "disagree",  3 = "neither  agree  nor  disagree",  4 = "agree"  and  5 = "strongly  agree". 
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"Not-applicable"  and  "non  response"  were  assigned  a score  of  6.  For  parametric  analyses, 
however,  underlying  variables  associated  with  scaled  responses  were  treated  as  continuous 
variables  with  interval  scales  (i.e.,  it  is  assumed  that  the  space  between  scores  1 and  2 is 
equal  to  the  space  between  scores  2 and  3).  Whereas  for  non-parametric  analysis  the  same 
variables  were  treated  as  ordinal.  Thus,  a score  of  1 is  smaller  than  2 as  well  as  3 and  so 
on;  but,  the  distance  between  1 and  2 was  not  considered  to  be  same  as  between  2 and  3. 

Categorical  questions,  (e.g.,  "Yes"  and  "No"  responses)  were  coded  as  1 and  2 
respectively  (e.g..  Questions  9 and  10,  Part  Two,  1996,  Appendix  B).  When  the  respondent 
was  asked  to  check  only  a single  response  from  a list  of  choices,  the  choices  were 
consecutively  numbered  (e.g..  Question  7,  Part  Two,  1996,  Appendix  B).  Whereas,  when 
the  participant  was  asked  to  check  all  that  applied,  in  any  list,  each  item  of  the  list  was 
treated  as  a binary  variable.  There  were  no  multiple  list  (check  all  that  apply)  questions  in 
1996  but  in  1993  there  were  two  questions  (concerning  disability  and  “household 
composition”)  which  asked  the  respondent  to  check  all  that  apply. 

Data  collected  in  1996  were  coded  in  the  same  manner  as  in  the  1993  survey. 
Responses  to  the  1996  survey  were  easier  to  code  compared  to  the  1993  survey.  The  coded 
data  were  entered  in  the  Statistical  Package  for  the  Social  Scientists  (SPSS)  program  at  the 
main  frame  computer  at  the  University  of  Calgary  for  statistical  analysis. 

No  systematic  numerical  coding  was  performed  on  the  open-ended  or  qualitative  data 
collected  through  the  1996  questionnaire.  Note,  that  no  open-ended  or  qualitative  data  was 
gathered  in  the  1993  base-line  survey. 


2.3. 1.6  Data  Analysis 

2.3.1.6.1  Quantitative  analysis. 

The  following  quantitative  analyses  were  performed  on  the  data: 


Frequency  distributions  were  performed  on  all  attitudinal  and  demographic 
variables.  Eyeballing  the  frequency  distributions  (even  without  descriptive 
statistics)  was  sufficient  to  answer  some  impact  questions.  For  instance,  for 
impact  question  8 (see  Section  2.3. 1.1)  it  was  sufficient  to  determine  the 
frequency  distributions  of  the  staff  and  board  demographics  to  determine 
changes  in  staff  and  board  demographic  profiles.  But  for  impact  questions  5, 
6 and  7,  frequency  distributions  and  descriptive  statistics  (means,  modes,  and 
standard  deviations)  were  performed  to  make  decisions  about  further  bivariate 
(one-way  ANOVA)  and/or  multivariate  analysis  (e.g.,  factor  analysis). 
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Factor  analyses  were  performed  on  the  22  attitudinal  items  common  to  both 
the  1993  and  1996  surveys  to  reduce  these  items  into  factors  or  underlying 
constructs  inherent  in  these  items.  The  function  of  factor  analysis  is  to  reduce 
a large  heterogenous  data  set  into  more  manageable  and  comprehensive 
homogenous  units  called  factors/constmcts.  Validity  is  the  extent  to  which  a 
test  or  an  instrument  measures  what  it  intends  to  measure.  Factor  analysis 
helps  determine  the  construct  validity  of  the  instrument.  “Construct  validity 
[which  is  a special  case  of  validity]  must  be  investigated  whenever  no  criterion 
or  universe  of  content  is  accepted  as  entirely  adequate  to  define  the  quality  to 
be  measured'’  (cited  in  Carmines  and  Zeller,  1979,  p.  22). 

Each  factor  is  a statistical  linear  combination  of  a group  of  variables  that  hang 
together.  Simply,  variables  in  a particular  factor  are  highly  correlated,  either 
negatively  or  positively.  Factor  analysis  contains  the  following  steps:  a) 
prepare  a correlation  matrix  (e.g.,  Pearson  product-moment  r correlations)  to 
assess  relationships  between  multiple  items/ variables  ^2;  b)  extract 
factors/hypothetical  variables  by  means  of  extraction  procedures;  c)  view  the 
initial  statistics  (e.g.,  Eigenvalues  and  percentage  variance  expMne;  and  d) 
determine  the  kinds  and  optimum  number  of  factors  which  explain  the  data  set. 

The  number  of  factors  selected  to  explain  the  framework  is  based  on  each 
factor’s  Eigenvalue  (factors  with  Eigenvalues  less  than  1 are  typically  excluded 
from  further  analysis)  and  the  percentage  of  total  variance  explained  (i.e., 
what  percentage  of  total  variance  is  explained  by  the  number  of  factors 
selected  to  explain  the  data  set).  Once  the  first  factor  (factor  1)  is  identified, 
the  variance  it  accounts  for  is  statistically  removed  (or  partialled)  from  the 
data.  Then  the  second  factor  (factor  2),  also  a linear  combination,  forms,  and 
the  process  continues  until  no  variance  is  left.  Thus,  any  extraction  of  further 
factors  would  be  meaningless.  This  process  assures  that  the  factors  are 
statistically  independent  (orthogonal).  However,  the  statistical  independence  is 
forced  upon  mathematically;  d)  rotate  selected  factors  in  order  to  maximize  the 
differences  between  factors.  Varimax  rotation  is  most  commonly  selected  for 
the  orthogonal  rotation;  e)  the  examination  of  a particular  factor  reflects  all 
the  variables  which  constitute  it.  Further,  the  factor  loadings  indicate  the 
strength  and  the  direction  of  the  relationship  between  the  variable  and  the 
factor.  That  is,  each  variable  which  is  selected  for  factor  analysis  correlates 
with  all  the  factors  by  means  of  correlation  indices  called  factor  loadings. 
Ranging  from  values  -1  to  +1  factor  loading  is  a measure  of  an  association 
between  a factor  and  the  variable  in  question.  The  higher  the  loading  the 
stronger  the  relationship;  the  negative  and  positive  direction  reflects  either  a 


Occasional  Pearson  product-moment  correlations  were  also  conducted  to  determine 
bivariate  relations:  Pearson  r ranges  from  -1  (perfect  negative  correlation)  to  + 1 (perfect  positive 
correlation). 
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negative  or  a positive  relationship  between  the  factor  and  the  variable  in 
question  (Tinsley  and  Tinsley,  1987). 


The  Cronbach  a co-efficients  were  computed  on  the  22  attitudinal  items  to 
check  the  reliabilty  or  internal  consistency  of  the  attitudinal  component  of  the 
instrument  and  the  reliability  of  the  four  factors  singularly.  ^^Reliability 
concerns  the  degree  to  which  results  are  consistent  across  repeated 
measurements.,..  Any  measuring  instrument  is  relatively  reliable  if  it's 
minimally  affected  by  chance  disturbances  (i.e.,  random  measurement  error) 
(Carmines  and  Zeller,  1987  pp.  15-16). 

Mathematically,  Cronbach ’s  ol  is  the  squared  correlation  between  the  score  a 
respondent  obtains  and  the  score  the  same  person  would  have  obtained  if 
questioned  on  all  of  the  possible  items  in  the  universe  (the  true  score). 
Cronbach ’s  ot  ranges  from  0 to  1.  Negative  values  occur  when  the  items  are 
not  positively  correlated  among  themselves  and  the  reliability  model  is  violated 
(Norusis,  1990). 

Analysis  of  Variance  (ANOVA)  was  conducted  to  determine  attitudinal 
changes  between  1993  and  1996  among  selected  subgroups  (e.g.,  1993  males 
vs.  1996  males,  1993  staff  vs.  1996  staff  of  a particular  agency)  as  well  as  the 
changes  in  relationships  between  selected  pairs  (e.g.,  between  males  and 
females).  This  test  helped  determine  answers  to  impact  questions  5,  6 and  7. 

ANOVA  tests  the  null-hypothesis  that  all  samples  have  been  drawn  from  the 
same  parent  population.  Mathematically  the  computation  of  ANOVA  involves 
separating  the  sample  variance  into  two  components:  within  the  sample  and  in- 
between  samples.  These  are  then  compared  using  the  F-test.  A significant  F 
indicates  that  the  two  groups  (or  more)  are  different.  Thus  two  groups  would 
also  have  different  means  (Porkess,  1991). 

Two-way  ANOVA,  an  extension  of  one-way  ANOVA  allowed  the  evaluators 
to  determine  the  joint  effect  and  interaction  of  two  or  more  factors  on  the 
dependent  variable.  In  this  evaluation  effect  and  interaction  tests  were 
employed  to  determine  the  gender  effect  (is  there  a significant  group  by  gender 
effect)  and  interaction  (is  there  a significant  gender  by  group  interaction)  while 
in  the  process  of  looking  at  changes  that  occurred  in  the  non-manager  and 
manager  sub-groups.  Are  the  changes  manifested  in  a non-manager  sub-group 
pure  (because  of  the  non-manager  role)  changes?  Or  is  gender  a confounding 
variable.  (Welkowitz,  Ewen  and  Cohen,  1976;  Norusis,  1990)?. 
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ANOVA  operates  on  the  following  underlying  assumptions:  a)  the 
observations/items  are  independent,  b)  variances  are  equal  for  all  treatment 
populations  (that  is  homogeneous),  and  c)  the  populations  are  normally 
distributed.  ANOVA  is  robust  to  the  last  two  assumptions  provided  that 
sample  sizes  are  about  equal.  Nonetheless,  Kolmogorov-Smirnov  (K-S)  and 
the  Bartlett  tests  were  performed  to  determine  population  distributions  and 
homogeneity  of  variance  respectively. 

2.3.1.6.2  Qualitative  analysis. 

Thirteen  open-ended  qualitative  responses  were  analyzed  by  means  of  content 
analysis.  "Content  analysis  involves  systematically  coding  messages  or  information  in  them, 
into  categories  [or  themes]  thus  allowing  quantitative  analysis"  (Chadwick,  Bahr  and 
Albrecht,  1984,  p.  239).  Content  analysis  is  a useful  supplement  to  quantitative  analysis  in 
the  interpretation  of  responses  to  open-ended  questions.  Results  of  the  above  content  analysis 
are  tabled  in  the  finding  section.  Note,  no  systematic  numerical  coding  was  conducted  on 
the  open  ended  responses.  Also,  open-ended  qualitative  data  were  not  collected  in  the  1993 
survey. 


2.3.2  Findings 


2.3.2.1  What  is  in  this  Section? 

This  section  presents  MOC’s  impacts  on  respondents’  attitudes,  environment  and  their 
demographic  profiles  between  1993  and  1996,  i.e.,  it  presents  comparisons  between  the 
results  of  the  baseline  and  impact  surveys.  In  addition,  it  provides  changes  in  the 
consumers’  profile  between  1993  and  1996. 


First,  this  section  provides  selected  descriptive  statistics  (frequencies, 
standard  deviations  and  means)  on  the  22  attitudinal  items  common  to  both 
1993  and  1996  workforce  surveys  (Table  1). 

Secondly,  this  section  describes  the  reliability  and  validity  of  the  attitudinal 
component  of  the  1996  instrument.  Results  of  factor  analysis  (Table  2)  and 
Cronbach  a are  presented  as  checks  for  validity  and  reliability  (also  known  as 
internal  consistency)  respectively. 

Thirdly,  this  section  documents  evaluation  findings  according  to  the  9 impact 
questions  mentioned  previously  (see  Section  2.3. 1.1).  Results  of  ANOVA, 
content  analysis,  and  selected  frequency  distributions  together  deal  with  the 
evaluation  questions.  The  F statistic  in  ANOVA  is  tested  at  an  a level  of  .05 
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(also  known  as  p value,  level  of  significance  or  Type  1 error).  We  did  not 
correct  the  a levels  by  Bonferrani  test  (Wilkinson,  1989).  But  for  the  sake  of 
accuracy  and  caution  the  readers  may  consider  a<  .01  to  indicate  an 
acceptable  level  of  statistical  significmice.  Nevertheless,  the  evaluators  have 
discussed  the  result  at  a significance  level  of  a <.05  (see  Section  2.3.3). 

Also,  see  Section  2.3. 1.6  for  rationale  and  algorithm  of  statistical  and  qualitative 
analyses.  For  the  interpretation  and  discussion  of  the  findings  see  Section  2.3.3. 

2.3.2.2  Response  Rates 

In  the  1993  survey  the  evaluators  realized  an  overall  53%  (475  out  of  891)  response 
rate  for  the  staff  and  9%  (611  out  of  6,770)  for  volunteers.  In  1996  the  evaluators  realized 
an  overall  56%  (258  out  of  455)  response  rate  for  the  staff  and  24%  (55  out  of  227)  for  the 
board.  Response  rates  for  individual  agencies  varied  in  both  the  surveys.  In  1993  staff 
response  rates  ranged  from  44%  to  100%.  In  1996  response  rates  ranged  from  30%  to  90%; 
whereas  in  the  same  year  the  board  response  rates  ranged  from  2%  to  57%.  Note,  in  1993 
the  survey  was  also  sent  to  non-board  volunteers.  Thus,  the  evaluators  could  not  determine 
the  response  rates  for  the  board  per  se. 

23.2.3  Checking  the  Validity  and  Reliability  of  the  In^stranient 

2.3.2.3.1  Descriptive  Statistics  of  the  22  Items 

Table  1 presents  means,  standard  deviations  (SD)  and  non-responses  (NR)  of  the  22 
items  in  both  the  surveys.  These  computations  were  conducted  on  only  the  staff  samples  of 
both  the  surveys.  These  computations  were  necessary  to  understand  the  central  tendencies 
and  the  non-responses  in  order  to  conduct  further  analyses.  Readers  should  bear  in  mind  the 
following  three  points:  a)  items  9 and  20  in  Table  1 were  measured  by  a five-point  priority 
(5=  “top”,  4= “high”,  3 -“medium”,  2 -“low”  and  1-  “not  at  all”)  scale  in  both  the 
surveys;  b)  in  1993  nine  out  of  the  remaining  20  items  were  measured  on  a five-point 
frequency  scale  but  in  1996  all  20  items  were  measured  on  a five-point  agreement  scale  (see 
Figure  2,  Section  2.3. 1.3)  and  c)  for  comparative  purposes  the  responses  to  these  20  items  in 
1993  were  treated  as  if  they  were  elicited  on  a five-point  agreement  scale  The  five-point 
agreement  scale  is,  5 -“strongly  agree”,  4 -“agree”,  3-  “neither  agree  nor  disagree”,  2 = 
“disagree”,  1 = “strongly  disagree”;  whereas  the  frequency  scale  is,  5 —“always”. 


In  Figure  2 the  22  items  are  arranged  according  to  their  sequence  in  the  1996  survey 
(Appendix  B);  whereas  in  Table  1 the  items  are  sequenced  according  to  the  four  factors. 


MOC’s  D^cription  & Impacts  Page  78 


r 


\,,  :;...ii'  ifft  0 

g >*^H|i^JNS5i;^P  to?,  [i5:;ifiM^ 

^MUU^ih 


WWJS?  liV  ''  ‘'-‘tjm  ,l||j)  ,3li^:(fe^-'fi»';^ 
u.'Ciiiiaj  i?'jiA9fW^  piif^  i „jjl  ^ *«^*i^e*' 

3ttt'  Mft  •J'ii  'iuimo  »!?*fe;,to« 

.'-■<{<>1  ai  ,myt  _■ 

5<ili  m 'bloqo’%a<»Ws*5»i^^^ 


«li> 


S:^  ^ ,w  ,i 


mm^Wt'Um 


»SS®' 


Ik^ 


'suit  y^,:m^. 


-"f^L 


'iiSS(» 


i " 


it  to  >0  (Hif> 


Mmm^ 


z^tioabml  Untim  sufi  bitgtmhrM  a«|;  ^ 

-'■j  i’iriT'n  .-:,■  i0®i1  :’>lcK>s1e  l5ti&ftaS[  ,, 

^ ' "’  ' ■■■^^,^„  ' '.fltfCi',.  ' ^jjpi  ■■  "^  ■ ■■'  tyi  ' . -IJ.  fit’ 

■£  r Tonq  i'rjioq- wfr  a y<f  t<wfl3|^.:f5^^t*^ 

— H'-'j  .!*  ofeii  rib  m k>ir 

, k ui*^'?*arvT<  «i  (to  tori«is$!fti  ato  (dM 

*mrxf-avi5  /^^o  md  ya'-te^ipariit 

.•Hxic^xjvii  /’  aff.>8  lfi;^.ci«5t3,s  Jrtip;;  tvH  m no  b^jt^  t)f^:l^  U ’ 

loif  '‘-rps|ii /acfxsoi"' ^«^ alitor 

cl  .«i  airwf.  yji'vuiwrt^  cw3J  ,'^tj&t§mfh’* 

:.vf  ... 

^ kf  r'is  ai  ^z-mL^fXM  n^  rt?  jpibiqw  t 4<3iriffc  4rt*;(uf»^  ""  «l^.  ,i-.' 

iwtiwrt  1 4l«di  M grtitrtosDi  (»3Qi»i*ipa»  o»,wsk^  ^fii  1 xetjfKssM/^ 


«Ku^ra  « i?  .^«imbCI 


ir'r-  -■ 


4 = “often”,  3 = "sometimes”,  2 = “rarely”,  1 = “never”. 


2.3.2.3.2  Conducting  Exploratory  Factor  Analysis 

Exploratory  factor  analysis  was  conducted  on  the  1996  staff  responses  (n=258)  with 
the  22  items  mentioned  earlier  to  check  construct  validity  of  the  instrument.  Principal  factor 
(extraction  technique)  and  varimax  (rotation  technique)  procedures  were  conducted  on  the 
data  set  to  reduce  the  22  items  into  four  factors  or  constructs  (Table  2).  In  this  report  the 
factors  are  also  referred  to  as  constructs.  Note,  that  Kaiser-Meyer-Olkin  (KMO)  of  0.85,  a 
measure  of  sampling  adequacy,  revealed  that  the  correlation  matrix  resulting  from  the  22 
items  was  adequate  to  do  factor  analysis:  **KMO  value  of  0.90* s is  considered  marvellous,  in 
0.80*s  as  meritorious,  in  the  0. 70* s as  middling,  in  the  0.60* s as  mediocre,  in  the  0.50* s as 
miserable  and  below  0.5  as  unacceptable"*  (Norusis,  1990,  p.  317).  For  factor  analysis  the 
missing  values  or  non-responses  were  substituted  by  mean  value  of  the  variable  in  question 
(Tabachnick  and  Fidell,  1989). 

The  four  factors  revealed  that  the  attitudinal  component  of  the  1996  instrument  had  a 
fair  degree  of  construct  validity.  Table  2 indicates  that  all  four  factors  together  explain 
approximately  54%  of  the  total  variance  (attributable  to  all  22  items)  of  the  responses.  Thus, 
these  four  factors  can  be  regarded  as  an  essential  part  of  any  diversity  inquiry  and/or 
organizational  change  work.  The  1996  workforce  survey  instrument  should  be  considered  as 
a comprehensive  instrument  rather  than  an  exhaustive  one. 


MOC’s  Description  & Impacts  Page  79 


. %■  ■ 


Table  1.  Descriptive  Statistics  of  the  22  Items:  Staff  Responses 


Items 

1996 

n=258 

1993 

n=475 

Mean 

SD 

NR 

Mean 

SD 

NR 

1.  There  is  confusion  about  how  to  commimicate  with 
people  who  appear  differeat 

2.44 

1.0 

13 

2.47 

.91 

17 

2.  People  are  not  treated  fairly  because  they  appear 
differait 

2.04 

.98 

8 

1.83 

1.09 

51 

3. 1 hear  racist  rmarks  in  my  organization 

2.17 

1.02 

9 

1.86 

.749 

58 

4.  My  co-woii(ers  need  to  be  more  underetanding  of  how 
peoide  in  minority  groups  feel 

2.97 

1.13 

28 

2.94 

1.15 

59 

5. 1 hear  sexist  ronarks  in  my  organization 

238 

1.15 

11 

231 

.85 

67 

6.  There  is  conflict  whai  dirershy  issues  are  raised  in  our 
organization 

2.48 

1.03 

16 

2.45 

1.02 

38 

7.  Cliaits/consnmers  with  specialized  needs  expect  services 
which  the  agmcy  can  not  provide 

2.78 

.87 

64 

2.70 

.79 

135 

8.  There  is  an  overall  plan  to  deal  with  diversity  issues  in 
our  organization 

4.06 

.89 

22 

337 

.91 

121 

9.  How  high  a priority  does  your  management  place  on 
increasing  organizational  openness? 

3.76 

.73 

7 

3.74 

.81 

17 

10.  There  is  commitment  to  change  at  the  top  of  the 
organization. 

338 

131 

33 

3.67 

1.10 

92 

11.  Staff  have  created  an  opai  forum  for  discussion 

3.83 

.97 

13 

330 

1.01 

98 

12.  There  is  adequate  training  for  staff  to  deal  with 
diversity  issues  and  n^ds 

335 

1.09 

23 

2.90 

1.0 

70 

13.  Our  agracy  only  thinks  of  mainstream  consumers  when 
we  advertise  our  programs 

2.87 

1.10 

21 

233 

1.10 

80 

14.  My  organization  provides  quality  services  to  people  of 
different  backgrounds 

432 

.88 

8 

3.67 

1.04 

77 

15.  Staff  are  motivated  to  woric  together 

3.92 

1.03 

7 

3.87 

.87 

17 

16.  Staff  know  to  whom  th^  should  refer  clients/consumers 
with  specialized  needs 

3.77 

1.02 

26 

3.95 

.80 

35 

17. 1 will  have  difficulty  being  supervised  by  someone  from 
an  ethnic  group  differait  from  my  own 

1.44 

.60 

7 

1.60 

.71 

19 

18. 1 will  have  difficulty  bong  supervised  by  someone  from 
the  opposite  sex 

1.47 

.64 

8 

139 

.73 

14 

19. 1 will  have  difficulty  woridng  with  people  whose  sexual 
orioitation  is  different  from  my  own 

133 

.68 

5 

1.69 

.86 

48 

20.  How  hi^  a priority  do  you  place  in  increasing 
organizational  opomess? 

3.81 

.71 

5 

3.74 

.81 

17 

21.  Opaimg  up  the  organization  will  make  my  job  more 
secure. 

333 

.95 

54 

334 

.87 

118 

22. 1 am  too  busy  doing  regular  woric  to  deal  with  diversity 
issues. 

234 

1.02 

13 

232 

.92 

16 
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Table  2.  Four  Factors  Extracted  From  the  Staff  Responses  to  22  Items  in  1996 
Survey:  Results  of  an  Exploratory 


Factors/Items 

Factor 

Variance 

Loadings 

Explained 

Fact0rl 

Freedom  to  Speak  up  on  Sendtive 

mm 

issues 

1 . There  is  confusion  about  how  to  communicate  with  people 
who  appear  different. 

.71 

2.  People  are  not  treated  fairly  because  they  appear  different. 

.64 

3. 1 hear  racist  remarks  in  my  organization. 

.68 

4.  My  co-workers  need  to  be  more  understanding  of  how 
people  in  minority  groups  feel. 

.65 

5. 1 hear  sexist  remarks  in  my  organization. 

.62 

6.  There  is  conflict  when  diversity  issues  are  raised  in  our 
organization. 

.60 

7.  Clients/consumers  with  specialized  needs  expect  services 
which  the  agency  can  not  provide. 

.50 

Factor! 

MtmagemeMJOedicatw  to 

mm 

OrgamzaMondl  Cpenness 

1 . There  is  an  overall  plan  to  deal  with  diversity  issues  in  our 
organization. 

.80 

2.  How  high  a priority  does  your  management  place  on 
increasing  organizational  openness? 

.72 

3 . There  is  commitment  to  change  at  the  top  of  the 
organization. 

.71 

4.  Staff  have  created  an  open  forum  for  discussion. 

.69 

5.  There  is  adequate  training  for  staff  to  deal  with  diversity 
issues  and  needs. 

.60 

6.  Our  agency  only  thinks  of  mainstream  consumers  when 
we  advertise  our  programs. 

- .52 

7.  My  organization  provides  quality  services  to  people  of 
different  backgrounds. 

.50 

8.  Staff  are  motivated  to  work  together. 

.49 

9.  Staff  know  to  whom  they  should  refer  clients/consumers 
with  specialized  needs. 

.43 

(Continued) 
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Table  2.  Four  Factors  Extracted  from  Responses  to  22  Items  in  1996 
Survey:  R^ults  of  an  Exploratory  Faettwr  Analysts  (Cont’d) 


Factors/Items 

Factor 

Loadings 

Variance 

Explained 

Britij^ng  B&wn  Barriers  ta 
Mrmg/pmnwting 

1 . 1 will  have  difficulty  being  supervised  by  someone  from  a 
different  ethnic  group  than  my  own. 

2. 1 will  have  difficulty  being  supervised  by  someone  from 

.86 

the  opposite  sex. 

3. 1 will  have  difficulty  working  with  people  whose  sexual 

.85 

orientation  is  different  from  my  own. 

.67 

Famr4 

Bersoml  DeMcadon  to  Orgmizadonal 
Openness 

mm 

1 . How  high  a priority  do  you  personally  place  in  increasing 
organizational  openness? 

.73 

2.  Opening  up  the  organization  will  make  my  job  more 
secure. 

.66 

3 . lam  too  busy  doing  regular  work  to  deal  with  diversity 
issues. 

- .64 

Note:  Except  for  item  2 in  Factor  2 ard  item  1 in  Factor  4,  responses  to  the  above  items  were  elicited  on  a five- 
point  agreement  scale  (l”“Strongly  Disagree”  and  5=  “Strongly  Agree”).  See  Figure  2,  Section  2.3. 1.3. 


MOC’s  Description  & Impacts  Page  82 


m 


' US'  V ,’’ 


# 


rJm 


„...■  ' , '.iv'.-Fv?: 


kr 


■{>*' 


Ji' tii^' 


'-(fr'irA'.  ..^'  *p, 


I mF' 


t ■ ■VLI—— 

.(■iVi „■■■  ■ -tit  : . 


4^7 


tf. 


SHKI^ft'^  ' i'  V 


te'i 


' ' '''^-;' 


%ti  ,m 


■-^igjf 


ii  4'- 


i ^ ^ lai'^ 

l-V^a  If  ItQ  :*»ij-*»f9  <W«M?  tuwdjl  i«te  <W  <NW*»J 

X.  t X^.m4r.<haXmf^^  m€ 


r''('v.‘ 


m 


'• 


M 


*..  A>^'' 


In  summary,  exploratory  factor  analysis  revealed  the  following  four  factors/constructs 
(Table  2): 

1)  Freedom  to  Speak  up  on  Sensitive  Issues  {7  items); 

2)  Management  Dedication  to  Organizational  Openness  (9  items); 

3)  Bringing  Down  Barriers  to  Hiring/Promoting  (3  items);  and 

4)  Personal  Dedication  to  Organizational  Openness  (3  items). 

The  following  passages  describe  the  compositions  (the  items  which  define  the  factor) 
of  the  four  factors,  their  contributions  in  measuring  organizational  changes  as  related  to  the 
MOC  project  and  their  reliability  co-efficients.  The  reliability  was  conducted  on  20  items 
(items  13  and  22,  Table  2,  were  excluded  because  of  their  negative  factor  loadings)  which 
produced  a Cronbach  a of  .31.  This  indicates  that  these  20  items  together  do  not  have  a 
high  internal  consistency  i.e.,  they  do  not  ‘hang  together’.  However,  as  documented  below, 
Cronbach  a’s  conducted  on  the  four  factors  individually  reflect  relatively  higher  internal 
consistencies  for  the  first  three  items  but  not  for  the  fourth  factor. 

Assigning  ‘names’  to  the  four  factors  was,  by  and  large,  a subjective  exercise.  Based 
on  the  same  (or  similar)  results  other  evaluators  may  have  given  different  headings  based 
upon  their  understanding  of  the  items  which  constitute  the  factors. 

2.3.2.3.1  Construct  1:  Freedom  to  Speak  up  on  Sensitive  Issues. 

This  factor  is  composed  of  seven  items.  All  seven  items  are  positively  correlated  to 
each  other  and  therefore  to  the  underlying  construct.  This  factor  explains  approximately  29% 
of  total  variance  in  the  data  set  (Table  2).  The  Cronbach  a of  0.83  (conducted  on  the  seven 
items)  indicates  a high  degree  of  reliability  or  internal  consistency  within  this  factor. 

Table  2 presents  seven  items  which  define  the  factors.  The  factor  loadings  range  from 
.50  to  .71. 

For  the  sake  of  argument,  a simultaneous  strong  agreement  with  all  of  the  items 
would  indicate  one  or  both  of  the  following: 

• The  organization(s)  in  question  at  best  has  critical  issues  to  resolve;  at  worst  it  can 
be  construed  as  a not-so-open  organization. 

• A shift  in  frequency  distributions  towards  the  agreement  end  of  the  scale  over  time 
(between  1993  and  1996)  would  imply  that  the  respondents  are  progressively  more  free  to 
speak  up  on  sensitive  issues. 
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2.3.2.3.2  Construct  2:  Management  Dedication  to  Oreanizational  Openness. 

This  factor  is  a constellation  of  nine  items.  Only  one  of  the  nine  items  is  negatively 

correlated  to  the  construct  and  therefore  to  the  other  eight  items  (Table  2):  “Our  agency  only 
thinks  of  mainstream  consumers  when  we  advertise  our  programs.  ” 

This  factor  explains  approximately  1 1 % of  the  total  variance  in  the  22  items.  A 
Cronbach  a of  .73  indicates  that  these  nine  items  collectively  can  be  used  as  a reliable 
measurement  of  the  construct  in  question.  The  factor  loadings  range  from  .43  to  .80 
(negative  sign  is  ignored  in  this  presentation).  “There  is  an  overall  plan  to  deal  with 
diversity  issues  in  our  organization”  has  a factor  loading  of  .80  and  “staff  knows  to  whom 
they  should  refer  clients/consumers  with  specialized  needs”  has  a factor  loading  of  .43  (Table 
2). 

For  sake  of  argument,  a simultaneous  strong  agreement  with  any  or  all  items 
excepting  item  six  and  strong  disagreement  with  item  six  would  indicate  that  the  management 
in  the  test  organization(s)  is  quite  dedicated  to  open  up  the  organization. 

2.3.2.3.3  Construct  3:  Brin^ne  Down  Barriers  to  Hirins/Promotin2, 

This  factor  is  a constellation  of  three  items.  All  three  items  are  positively  correlated 
to  each  other  and  to  the  underlying  construct.  For  sake  of  argument,  a strong  disagreement 
with  any  or  all  three  items  would  indicate  that  the  organization  in  question  is  not  as  open  as 
it  can  be  or  ought  to  be.  This  factor  explains  approximately  9%  of  the  total  variance.  A 
Cronbach  a of  .76  reflects  that  these  items  constitute  a reliable  measure  of  this  factor. 
Responses  towards  the  disagreement  end  of  the  scale  with  all  or  any  of  the  above  items 
would  indicate  that  the  organization  in  question  is  open  to  the  idea  of  Bringing  Down 
Barriers  to  Hiring/Promoting. 

Factor  loadings  range  from  .67  (“I  will  have  difficulty  working  with  people  whose 
sexual  orientation  is  different  from  my  own”)  to  .86  (“I  will  have  difficulty  being  supervised 
by  someone  from  an  ethnic  group  different  from  my  own”)  (Table  2). 

2.3.2.3.4  Construct  4:  Personal  Dedication  to  Organizational  Openness. 

This  factor  is  a constellation  of  three  items.  Two  items  are  positively  correlated  to 
each  other  and  to  the  underlying  construct.  The  remaining  third,  “I  am  too  busy  doing 
regular  work  to  deal  with  diversity  issues”  is  negatively  correlated  with  the  other  two  as  well 
as  the  underlying  construct.  Factor  loadings  range  from  -.64  to  .73  (Table  2).  A negative 
Cronbach  a of  - .47  reflects  that  these  three  items  collectively  are  not  a reliable  measure  or 
instrument.  Thus,  students  of  diversity  should  revise  and  build  on  this  construct  for  future 
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2.3.2.4  MOC’s  Impacts  on  The  Organization 

Impact  Question  1 

How  did  the  MOC  project  influence  changes  in  the  internal  workings  of 


According  to  the  responses  to  question  lb  in  the  1996  survey,  MOC  impacted  the  staff 
and  board  positively  (see  Appendix  B).  A ten-point  “quality  of  difference”  scale  --  ranging 
from  “good”  (1)  to  “bad”  (10)  --  was  devised  to  measure  the  impacts  of  MOC  on  the  internal 
working  of  the  organization/'^  The  responses  were  further  recoded  into  three  categories 
which  represent  a gradient  of  “quality  of  difference”,  “high”,  “medium”  and  “low”:  responses 
of  l-3=“high”,  4-6=“medium”  and  7-10=  “low”. 

Fifty-percent  (50%)  of  staff  dinA  60%  of  hoard  members  reported  that  MOC  had  a 
“high  quality”  (‘positive’,  ‘good’)  influence  on  the  workings  of  their  agencies  (Table  3A). 
Also,  eyeballing  the  frequency  distributions  of  the  responses  of  6 sub-groups  indicate 
that  comparatively  fewer  females  and  non-managers  reported  that  MOC  made  a “high  quality” 
impact  on  their  respective  organizations.  Only  47%  of  both  the  sub-groups  reported  a the 
“high”  quality  impact.  The  responses  of  the  six  staff  sub-groups  were  analyzed:  Female, 

Male,  Manager,  Non-manager,  those  who  consider  themselves  belonging  to  one  or  more 
visible  minority  group  (referred  to  as  VM),  those  who  do  not  consider  themselves  belonging  to 
one  or  more  visible  minority  group  (referred  to  as  NVM)  (Table  3A).  Also,  see  Section 
2.3.2. 8 for  sample  sizes  and  definitions  of  the  six  sub-groups  extracted  from  the  1996  staff 
survey  responses 


In  the  1996  survey  two  different  10-point  scales  were  devised  to  determine  MOC’s  impacts: 
“Quality  of  difference”  and  “Degree  of  difference”  (see  Section  D,  la,  lb,  2a  and  2b,  Appendix  B).  The 
variables  la  and  lb  were  positively  correlated  (Pearson  r=0.56).  Thus,  throughout  this  report  only  the 
“Quality  of  Difference”  is  reported  as  a measure  of  MOC’s  impacts. 


15 


The  two  staff  sub-groups,  namely  the  “self  identified  visible  minorities  or  consider  themselves 
as  visible  minority”  and  “other  than  self-identified  visible  minorities  or  do  not  consider  themselves  visible 
minority”,  were  extracted  from  binary  responses  to  the  following  question  in  both  the  surveys:  J CGS^der 
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Table  3A.  MOC’s  Effects  on  the  Working  of  the  Organization: 
Sub-Groups’  Perspectives 


“Quality  of  Difference” 

Sub-Group 

High 

Medium 

Low 

NR 

mm 

Total  Sample  (n=2S8) 

130  (50%) 

68  (26%) 

8(3%) 

52  (20%) 

• Females  (n=198) 

94  (47%) 

52  (26%) 

8(4%) 

44a2%) 

• Males  (n=48) 

29  (60%) 

13  (27%) 

0 

6(13%) 

• Managers  (n=61) 

37  (61%) 

16  (26%) 

4 (7%) 

4(7%) 

• Non-managers 
(n=178) 

83  (47%) 

47  (26%) 

2(1%) 

46  (26%) 

• VM  (n=38) 

21  (55%) 

9 (24%) 

0 

8(21%) 

• NVM(n=211) 

105  (50%) 

58  (28%) 

8(4%) 

40  (19%) 

Total  Sample 

n=55 

33  (60%) 

11  (20%) 

1(2%) 

10  (18%) 

Notes: 

NR:  (Non-response)  is  included  in  the  above  computations;  and 

NR:  pertaining  to  the  three  diversity  variables  (gender,  visible  minority  status  and  organizational  position)  is  not 
presented. 
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The  numerical  scale  used  to  assess  MOC’s  impacts  was  considered  inadequate  to 
gauge  the  richness  of  respondents’  feelings.  Therefore,  evaluators  also  elicited  open-ended 
comments  about  what  “good”  and  “bad”  meant  to  the  respondents.  It  provided  a deeper 
understanding  of  the  MOC  project  and  simultaneously  helped  determine  what  should  (or 
should  not)  be  measured  in  an  evaluation  of  diversity  initiatives  and  interventions. 

Open-ended  comments  made  by  both  the  staff  and  the  board  suggested  MOC  was 
mostly,  but  not  entirely,  a positive  influence  (e.g.,  raised  awareness,  helped  in  removing 
barriers)  on  the  internal  workings  of  the  organizations:  67%  of  comments  (99  out  of  148) 
were  positive  in  nature.  See  Table  3B  for  positive  sub-themes  and  the  number  of  comments 
included  under  them.  MOC  was  praised  because  it  provided  education,  understanding  and 
awareness  in  how  to  deal  and  interact  with  people  irrespective  of  their  backgrounds,  gender, 
income  levels,  sexual  orientation,  age,  family  circumstances  and  religion/spirituality. 

However,  like  any  other  project  as  complex  and  with  such  diverse  perspectives,  MOC 
was  sometimes  viewed  as  either  negative  (8%  of  the  comments)  or  ineffective  (15%  of  the 
comments)  in  what  it  set  out  to  accomplish.  Table  3B  also  illustrates  why  MOC  was 
considered  a negative  influence  on  the  organizations. 

Some  board  and  staff  were  confused  about  MOC’s  impacts  and  outcomes:  10%  (15 
out  of  148)  of  comments  described  MOC  as  a dilemma.  The  converging  message  inherent  in 
all  15  comments  was  “MOC  was  good  BUT  ...  for  this  and  for  that.”  To  illustrate  the  case 
in  point,  the  evaluators  selected  verbatim  comments  (Table  3B). 

In  summary,  MOC  impacted  the  internal  workings  of  14  agencies  in  at  least  four 
distinct  ways:  positively,  negatively,  no-effect  and  in-between. 
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Table  3B.  MOC's  Effects  on  the  Workings  of  the  Organizations,  Reported  By  Staff 
and  Board:  Results  of  Anatyi^ 


Theme 

No  of  Comments 
=148 

• Provided  education/traimng/awareness  etc.  to  staff  and  board  members 

45  (30%) 

• In^etus  to  remove  barriers  in  service  delivery  i.e., 
more  diversified  program  and  service  delivery 

24  (16%) 

• In^etus  to  formalize  diversity  initiatives  e.g.  policy  formulation,  forum  for 
discussion  etc. 

23  (16%) 

• Impetus  to  make  board  and  other  volunteer  conq>osition  more  diverse 

3(2%) 

• In^etus  to  allocate  resources  for  diversity  initiatives 

3(2%) 

• In^etus  to  make  staff  con^osition  more  diverse 

■i..aa.) 

99  (67%) 

Examples 

- “The  process  has  invited  people  to  unite  in  woridng  towards 
one  goal” 

- “Provides  a forum  for  discussion  and  reflection  “ 

- "Made  us  look  more  closely  at  our  policies  and  be  sensitive  to 
filling  gaps  that  may  exist  as  they  relate  to  accessibility  “ 

- "Freedom  to  ask  questions  ” 

- “Additional  time  available  to  deal  with  the  issues  “ 

• MOC  was  a waste  of  time 

6(4%) 

• MOC  process  was  unethical 

4(3%) 

* MOC  promoud  feelings  of  reverse  discrimination 

2 (t%) 

Examples 

12(8%) 

- “MOC  is  a joke.  People  of  top  management  are  all  talk  but  no 
do“ 

- “Just  given  Up  services  and  not  really  committed  to  the 
process  “ 

- “Too  many  stats  [which]  gets  away  from  goal  to  serve  my 
community  ” 

- “We  must  be  careful  not  to  lose  sight  of  who  we  are  and  where 
we  came  from.  We  must  notforsalx  of  our  majority  only  for 
sake  of  a small  minority  “ 

(Continued) 
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Table  3B.  MOC's  Effects  On  the  Workings  of  Organizations,  Reported  By  Staff 
and  Board:  Results  of  Aii^ysi$  (Cont’d) 


Theme 

No  of  Comments 
=148 

IMe  orm  Sff&am  Of^missadm 

• Organization  still  the  same  as  before  MOC 

22  (15%) 

Examples 

- “We  were  an  open  agency  before  the  process  “ 

- “Our's  is  afar-seeing  agency...  before  Futureways" 

- “The  agency  has  always  accepted  and  aided  the  so  called 
minorities  ” 

• MOC  had  or  could  have  had  a positive  effect  on  the  organization  BUT  .... 

15  (10%) 

Examples 

- “When  the  purpose  of  the  agency  is  somewhat  ignored  while 
staff  get  all  caught  up  in  MOC  work. . . it  leaves  staff  feeling 
divided,  impotent,  not  good  enough  angry  and  isolated" 

- ‘Management  commitment  has  been  somewhat  lacking  because 
of ...  the  various  other  organizational  and  structural  challenges 
we  have  faced" 
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2.3.2.5  MOC’s  Impacts  on  Personal  Being 
Impact  Question  2 

How  did  the  MOC  project  influence  personal  changes  in  board  and  staff 
members  in  relating  to  diversity  issues  (i.e.,  have  key  actors  acquired 
further  knowledge,  skills  and  comfort  in  dealing  with  diversity  issues)? 


MOC  seems  to  have  made  a very  definite  positive  personal  difference  for  less  than 
half  of  the  staff  and  the  board:  43%  staff  and  47%  board  reported  in  the  “high”  category 
(Table  4A).  A relatively  higher  percent  (57%)  of  managers  reported  MOC’s  impacts  to  be 
of  “high”  quality  followed  closely  by  the  VM  sub-group  (53%  reported  MOC’s  impacts  to  be 
“high”  quality).  Also,  38%  (94  out  of  244)  of  the  staff  and  board  who  reported  in  the 
“high”  category  for  the  MOC’s  impact  on  the  organizational  workings,  also  reported  in  the 
“high”  category  for  personal  changes.  There  is  a positive  relationship  between  the  two 
variables  (Pearson  r=.67,  p=.(XX)). 

Content  analysis  of  open-ended  comments  reflect  that  MOC  had  a variety  of  impacts 
on  respondents’  personal  being/lives:  negative,  positive  and  in-between.  Table  4B 
documents  that  the  majority  of  comments  (69%)  make  a definitive  overall  statement  about 
personal  gains  made  by  the  respondents  due  to  MOC’s  intervention.  In  addition,  comments 
which  fit  three  other  categories  emerged:  personal  losses  (e.g.,  feeling  of  reverse 
discrimination),  personally  no  gain,  no  loss  (sometimes  phrased  as  Tm  still  the  same”), 
and  a category  of  confused  and  mixed  feelings  ( such  as,  MOC  has  impacted  my  life  and  it  is 
difficult  [because]  ...  the  agency  has  not  moved  to  the  same  degree,). 

Table  4B  presents  selected  verbatim  comments  to  exemplify  the  nature  of  personal 
gains,  personal  losses,  personally  no  gain  no  loss  and  mixed  feelings. 
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Table  4A.  MOC’s  Influence  on  the  Staff  and  Board  Personally: 
Sub-Groups’  Perspective 


“Quality  of  Difference” 

Sub-Group 

High 

Medium 

Low 

NR 

-mm. 

• Tnfiil  SampIP 

fa=2S8) 

111  (43%) 

92  (36%) 

8(4%) 

47  (18%) 

• Females  (n=198) 

81  (41%) 

71  (36%) 

8(4%) 

38  (19%) 

• Males  (n=48) 

23  (48%) 

18  (20%) 

0 

7 (15%) 

• Managers  (n=61) 

35  (57%) 

18  (30%) 

5(8%) 

3(5%) 

• Non-managers 
(n=132) 

67  (38%) 

67  (38%) 

2(1%) 

42  (24%) 

• VM  (n=38) 

20  (53%) 

11  (29%) 

1(3%) 

6 (16%) 

• NVM  (n=211) 

89  (42%) 

78  (37%) 

7(3%) 

37  (18%) 

MHf 

26  (47%) 

20  (36%) 

0 

9 (16%) 

Total  Samide 
(n=55) 

Notes: 

NR:  (non-response)  is  included  in  the  above  confutations;  and 

NR:  pertaining  to  the  three  diversity  variables  (gender,  visible  minority  status  and  organizational  position)  is  not 
presented. 
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Table  4B.  MOC'S  Effects  On  Personal  Being/Lives,  Reported  By  Staff  and  Board 
Results  of 


Theme 

No  of  Comments 
=154 

• KnowledgeAJnderstanding/Education 

23  (18%) 

/Learning  etc. 

• Awaieness/V alidation/SoIidification  of  Views 

21  (14%) 

• Creates  Opportunities 

20  (13%) 

• Self  Examination/Evaluation 

15  (10%) 

• Positive  Work  Environment 

9(6%) 

• Personal  Growth 

9(6%) 

• Personal  Openness 

5(3%) 

• Tolerance/Acceptance/Respect 

5G%) 

107  (69%) 

- "Happy  to  work  with  people  who  are  comfortable  discussing 
and  addressing  diversity  issues  in  a knowledgable  way.  " 

-"lam  more  aware  of  cultural  differences.  I have  become 
more  proud  of  my  ethnic  background.  " 

- "I  feel  lucky  to  be  able  to  examine  my  own  privilege  and 
racism  in  order  to  change.  " 

- "Easier  to  handle  interpersonal  differences. " 

- "Better  able  to  deal  with  issue  that  client  brings  to 
therapy. " 

- "I  feel  more  comfortable  counselling  clients  from  other 
cultures. " 

• Feeling  Left  Out/Reverse  Discrimination 

Example 

5(3%) 

- "My  culture  and  backgrourulfor  more  than  200  years  is 

Canadian.  I would  like  to  be  recognized  too.  I lilk 
multiculturalism  and  diversity,  but  I would  like  to  be  included 
as  well  and  not  always  giving  up  my  traditions.  " 

IBiiiliiliiiiiilil 

• Still  The  Same 

Examolefs): 

- "I'm  still  the  same. " 

25  (16%) 

- "My  work  has  nothing  to  do  with  MOC ....  Personally,  my 
opinions  have  not  been  influenced  by  the  change.  " 

- "I  have  always  been  able  to  work  with  people  whether  they 
had  different  sex  orientation  or  race.  " 

(Continued) 
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Table  4B.  MOC'S  Effects  On  Personal  Being/Lives,  Reported  By  Staff  and  Board: 
Residts  of  Ctmtent  Atiaty^  (Cont’d) 


Theme 

No  of  Comments 
=154 

• MCX:  Was  Good  ....BUT 

11  (7%) 

ExmpMsl' 

- "MOC  has  impacted  my  life  and  it  is  difficult  [because]  ...the  agency  has  not 
moved  to  the  same  degree. " 

- "Ido  not  believe  in  forcing  an  outside  process  on  an  organization.  " 
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2.3.2.6  MOC’s  Impacts  on  Professional  Practices 
Impact  Question  3 


How  did  the  MOC  project  influence  professional  changes  in  staff  and  board 
members  in  relating  to  diversity  issues? 


The  majority  of  staff  respondents  (78%)  felt  that  MOC  made  quite  a difference  in  their 
professional  lives.  That  is,  78%  of  the  responses  were  at  the  “lot-of-difference”  end  of  the 
scale.  (See  Table  5 A for  staff  responses  on  a 10-point  difference  scale,  1 = “lot  of  difference” 
and  10=  “no  difference”.)  Board  members  were  not  asked  this  question  (see  Question  3b, 
SectionD,  Appendix  B).  Non-responses  and  board  responses  were  excluded  from  this  analysis. 


Table  5A.  Degree  of  Difference  to  Professional  Practices,  Elicited  On  a 10-Point  Difference  Scale 
A Lot  of  Difference  (n=258)  No  Difference 


1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

NR 

7 

12 

27 

26 

39 

6 

3 

7 

2 

12 

117 

(3%) 

(5%) 

(11%) 

(10%) 

(15%) 

(2%) 

(1%) 

(3%) 

(1%) 

(5%) 

(45%) 

Key:  1 = “A-lot-  of-  difference”  and  10  = “No  difference”;  NR=  “Non-response”. 


Analysis  of  open-ended  comments  gleaned  positive,  no  effects  and  mixed  feelings 
type  of  comments.  A total  of  53  out  of  68  (78%)  comments  were  positive.  Sub-themes 
under  positive  comments  include  (Table  5B): 

■ Increased  services  to  a diverse  consumer  population; 

■ Providing  the  impetus  to  make  diversity  an  area  to  learn  about  in  social 

work  and  human  services; 

■ Providing  the  impetus  to  change  educational  institutions  (e.g.,  curriculum) 
regarding  diversity  and  related  topics; 

■ Providing  the  impetus  to  change  some  aspects  of  professional  associations; 

■ Providing  the  skills  to  change  (or  fine  tune)  professional  practices; 

■ Creating  more  demand  for  human  service  practitioners  with  a focus  or 
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specialty  in  working  on  diversity  within  their  profession;  and 

■ Providing  an  impetus  to  interact  with  other  professionals,  i.e.  MOC  promoted 
inter-disciplinarity  and  collaboration. 

Twenty-two  percent  (22%)  of  the  positive  comments  about  the  impact  of  MOC  were 
attributable  to  the  sub-theme,  increased  services  to  a diverse  consumer  population.  On  an 
abstract  level  (hard-to-measure)  21%  of  the  comments  relate  to  awareness/education.  None 
of  the  participants  reported  negative  impacts  on  their  professional  practices.  But  15  out  of  68 
(22%)  comments  reflected  that  for  some  MOC  made  “little  or  no  effect”  and  others  were 
ambivalent  or  had  “mixed  feelings”  about  MOC. 
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Table  SB.  MOC'S  Effects  on  Professional  Practices,  Reported  By  the  Staff: 
Results  of  Aii^ysis 


Theme 

No  of  Comments 
=68 

Effects 

• Increased  services  to  a diverse  consumer  population 

15  (22%) 

• Increase  in  knowledge,  awareness,  deeper  understanding,  etc. 

14  (21%) 

• In^etus  to  interact  with  other  professionals  ie.  promoted  inter- 
disciplinarity 

8(12%) 

• Provided  skills  to  change  (or  fine  tune)  professional  practices 

6(9%) 

• Created  more  demand  for  experts  to  practice  in  the  area  of  social 
services/created  employment  opportunifies 

5(7%) 

• Provided  impetus  to  change  educational  institutional  (e.g.  curriculum) 
regarding  diversity  and  relat^  topics 

3(4%) 

• Provided  impetus  to  make  diversity  an  area  to  learn  in  social  work  and 
services 

1(1%) 

• Provided  impetus  to  change  some  aspects  of  professional  associations 

1 a%i 

53  (78%) 

Examples 

- “I feel  that  there  is  a great  number  of...  students  who  will  join  our 
program.  ” 

- “ There  are  more  demands  for  professionals  such  as  myself  with 
expertise,  skills  and  Icmguage  to  deal  with  other  cultures.  " 

- “I  see  changes  in  the  School  of  Social  Workers  curriculum  related 
to  diversity.  ASSW  conferences  have  also  reflected  that.  " 

- “Interaction  of  agencies  bring  motivation  to  be  aware  and  deal  with 
[diversity]  issues.  “ 

- “Have  changed  die  way  I do  therapy.  " 

• Professional  services  and  education  still  the  same 

9(13%) 

E^mpks 

- “ The  majority  of  clients  are  still  white,  English  speaking 

Canadians.  “ 

- “Minimum  changes  at  professional  levels.  “ 

- “I found  the  professions  have  been  cogrtizant  of  multicultural  issues 
prior  to  MOC.  “ 

• MOC  could  have  been  good/positive  ...  BUT 

6(9%) 

Mmpks 

- “My  profession  is  struggling  to  survive.  “ 

- “Less  resources  for  clients,  more  different  problems  to  deal  with.  “ 

- “ Community  professionals  talk  about . . . finding  not  necessarily 
clients. " 
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2.3.2.7  MOC^s  Impacts  on  the  Community 
Impact  Question  4 

Did  the  MOC  project  contribute  to  a change  in  programs  and  services  in  the 
social  service  and  health  sector  in  Calgary?  (e.g.,  are  more  diverse  people 
accessing  health  and  social  services?) 


The  majority  of  the  respondents  reported  that  MOC  made  a difference  in  the  social 
service  and  health  sector  in  Calgary  (Table  6A):  72%  of  the  responses  (of  both  board  and 
staff)  were  concentrated  on  the  “lot-of-difference”  end  of  the  scale  (i.e.,  1 to  5).  Non- 
responses were  excluded  in  the  above  computation. 


Table  6A.  Degree  of  Difference  to  the  Community-at-Large,  Elicited  On  a 10-Point  Difference 
Scale 

A Lot  of  Difference  (n=313)  No  Difference 


1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

NR 

10 

9 

23 

36 

60 

13 

6 

9 

8 

18 

121 

(3%) 

(3%) 

(7%) 

(12%) 

(19%) 

(4%) 

(2%) 

(3%) 

(3%) 

(6%) 

(39%) 

Key:  l = ’’A-lot- of- difference”;  10= No  Difference.  NR=  Non-responses 


A look  at  Table  6B  indicates  that  MOC  had  a positive  effect  (more  openness  and 
more  partnerships  among  agencies,  etc.)  on  the  community  at-large:  46%  (45  out  of  97) 
suggest  that  MOC  had  a positive  effect  on  the  social  services  and  health  sector  in  Calgary. 
Notably,  it  helped  social  service  agencies  to  be  more  accessible  2md  more  open.  In  a small 
way  board  and  staff  respondents  saw  evidence  of  sensitivity  in  their  micro-environment 
concerning  diversity  issues  and  needs.  However,  it  must  be  noted  that  during  the  MOC 
project  there  were  several  other  confounding  factors  which  likely  contributed  to  the  positive 
nature  of  the  outcomes.  Some  of  these  included  federal  and  provincial  government  policies 
(including  multicultural  policies),  restructuring  and  funding  imperatives,  curriculum  changes 
in  the  training,  professional  education  and  in-servicing  of  social  services  professionals. 

Similarly,  the  negative  impacts  (e.g.,  reduction  of  services,  all  issues  forgotten) 
more  than  likely  were  combinations  of  forces  beyond  MOC’s  control  (e.g.,  funding  cut- 
backs, lack  of  resources,  etc.).  On  the  extreme  negative  end  of  the  continuum,  however, 
respondents  reported  frustration  and  anger  among  staff  of  non-profit  agencies  against  the 
United  Way.  Lastly,  many  comments  indicated  that  there  were  both  negative  and  positive 
confounders  which  made  it  difficult  (if  not  impossible)  to  assess  MOC’s  influence  on  the 
community-at-large. 
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Table  6B.  MOC'S  Effects  On  The  Community-at-large,  Reported  By  Staff 
and  Board:  Results  of  Ai^ysis 


Theme 

No  of  Comments 

=97 

Hiiiiiiiiii 

• Service  agencies  more  open/accessible/decreased  barriers 

21  (22%) 

• More  partnership  and  collaboration  in  the  community 

15(15%) 

• Evidence  of  sensitivity/awareness/education 

8(8%) 

• Hiring  practices 

1(1%) 

45  (46%) 

Examples 

- "The  message  is  getting  out  and  people  are  seeing  the  benefits 
of  diversity  " 

- “Seen  many  more  collaborative  efforts  between  agencies  and  a 
great  deal  of  discussion  in  regards  to  mutually  beneficial 
alliances  " 

- “More  culturally  sensitive  services  offered” 

- "Hiring  practices  — looking  at  diversity  as  an  advantage  not  a 
liability  ” 

• Government  poUcy 

• Change  in  curriculum/  changes  in  other  health  care  system 

2 (2%) 

1(1%) 

3 (3%) 

Examples 

- "Government  policies  dictate  that  minorities  be  served 
equally  with  the  dominant  groups 

- "Changes  to  curriculum  at  U of  C social  work  program 

- “The  biggest  changes  are  in  agencies  outside  of  the  Futureway 
process  e.g.  Health  Authority  md  Alberta  Social  Services.  It 
would  be  presuming  too  much  to  assume  this  process  has  had  any 
major  chemge  in  Cdlgary.” 

(Continued) 
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Table  6B.  MOC'S  Effects  On  The  Community-at-large  as  Reported  By  Staff 
and  Board:  Results  of  C^et^  Aii^ysis  (Cont’d) 


Theme 

No  of  Comments 

= 97 

Wga^  nf  MM 

5(5%) 

• Reduction  of  services/decreased  quality  of  services 

• All  other  issues  forgotten 

1 (1%) 

• MOC  was  not  handled  well 

1 (1%) 

7(7%) 

Examples 

- “Vulnerable  people  are  not  receiving  services  previously 
available  to  them.  “ 

- “See  a lot  of  anger  among  staff  of  non-profit  agencies  against 

United  Way.  “ 

- T have  seen  services  cut  rather  than  improve  “ 

- In  the  process  of  transformation  there  has  been  a reduction 
(overall)  in  the  availability  of  some  services.  “ 

• Funding  cut  back 

13  (13%) 

• Lack  of  resources 

14  (14%) 

• Mainstream  thinking 

1(1%) 

• Lack  of  government  policy 

1(1%) 

Examples 

29  (33%) 

- 7 think  finding  cut  backs  has  had  a greater  [negative]  impact 
(All  of  the  CM  backs  seem  to  have  services  less  available  than 
before)  ” 

- “Mainstream  thinking  still  interferes  with  diversity 
implementation  " 

• Community  still  the  same 

8(8%) 

Examples 

- 7 have  not  seen  the  change  " 

- “Nothing  noticeable  — still  many  barriers  to  clients  “ 

• Can  not  be  sure  if  MOC  made  any  difference 

5(5%) 
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2.3.2.8  MOC’s  Impacts  on  Various  Sub-Groups 
Impact  Question  5 


How  have  the  attitudes  of  selected  sub-groups  changed  between  1993  and  1996  in 
relating  to  diversity  issues  (e.g.,  how  have  males  changed  their  attitudes  towards 
diversity  or  how  have  managers  changed  their  attitudes  towards  diversity 
between  1993  and  1996)? 


Tables  7B  to  7E  present  the  results  of  one-way  ANOVA  (analysis  of  variance)  based 
on  attitudinal  changes  realized  by  six  staff  sub-groups  and  the  board.  To  reiterate,  the 
following  is  a list  of  sub-groups  analyzed  along  with  their  sample  sizes  in  both  the  1993  and 
1996  surveys 

Figure  3.  Seven  Sub-Groups  Analyzed 

■ Male  (1993,  n=  83;  1996,  n=48); 

■ Female  (1993,  n=379;  1996,  n=198); 

■ Manager  (1993,  n=108;  1996,  n=61); 

■ Non-manager  (1993,  n=315;  1996,  n=178); 

■ VM  (1993,  n=62;  1996,  n=38); 

■ NVM  (1993,  n=388;  1996,  n= 211);  and 

■ Board  (1993,  n=137;  1996,  n=55). 


There  are  non-responses  for  all  the  three  variables  (gender,  position  and  visible  minority 
status)  reflected  in  the  6 sub-groups  in  both  the  surveys. 
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Table  7A.  The  Matrix  Presenting  the  Compositions  of  the  6 Staff  Sub-groups  in  1993  and  1996. 
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The  VM  sub-group  is  composed  of  staff  who  consider  themselves  to  be  part  of  a 
visible  minority  cultural  group;  whereas  the  NYM  sub-group  do  not  consider  themselves  to 
be  part  of  a visible  minority  sub-group  Members  of  the  VM  sub-group  could  be 
physically  and/or  mentally  disabled  or  belonging  to  an  ethnic  minority  group  or  any  other 
characteristics  they  choose. 

The  frequency  distributions  of  salient  variables  in  the  1996  survey  revealed  that  only 
74%  (mean  length  of  stay =16.42  years)  of  the  VM  sub-group  was  bom  outside  of  Canada; 
and  only  8%  of  the  total  sub-group  reported  themselves  as  disabled  (physically  and/or 
mentally).  Conversely,  in  1996  the  majority  (85%)  of  the  NVM  sub-group  were  bom  in 
Canada,  (i.e.,  15%  of  the  respondents  who  were  not  bom  in  Canada  - mean  length  of  stay  in 
Canada =23. 35  years  - but  did  not  count  themselves  as  part  of  the  VM  sub-group)  and  4%  of 
respondents  reported  themselves  as  being  disabled.  Also,  in  1996  three  (out  of  10)  disabled 
respondents  counted  themselves  as  part  of  the  VM  sub-group;  whereas  seven  (out  of  10) 
counted  themselves  as  part  of  the  NVM  sub-group.  Further,  only  5%  (10  out  of  187)  of 
respondents  who  were  bom  in  Canada  considered  themselves  as  part  of  the  VM  sub-group 
and  93%  considered  themselves  as  part  of  the  NVM  sub-group.  Obviously,  ethnicity  is  a 
stronger  indicator  (whether  or  not  bom  in  Canada  is  a proxy  measure)  than  various  forms  of 
disabilities  of  whether  or  not  an  individual  considers  him/herself  to  be  part  of  a minority 
group  in  Canada. 

Overall  the  six  staff  categories  can  be  viewed  as  mutually  exclusive  pairings  or  dyads 
of  three  (e.g.,  male  and  female,  manager  and  non-manager).  These  six  staff  sub-groups 
presented  an  opportunity  to  determine  changes  related  to  three  important  diversity-related 
variables:  gender,  organizational  role  and  ranking,  and  perceived  status  as  a visible 
minority.  In  addition,  board  members  were  considered  a separate  sub-group  for  comparative 
purposes.  (Because  of  the  small  sample  size,  the  board  sub-group  was  not  further  broken  into 
sub-groups  in  the  same  way  staff  were.)  These  seven  sub-groups  are  unique  in  their 
compositions.  Nonetheless,  evaluators  took  care  in  statistically  mling  out  the  influence  or 
effect  of  a potential  confounding  variable  while  investigating  a particular  variable.  To 
illustrate,  the  evaluators  mled  out  gender  effect/influence  while  determining  changes  in  the 
non-manger  sub-group. 


For  the  sake  of  simplicity,  VM  and  NVM  were  selected  instead  of  CTAVM  (considered 
themselves  as  visible  minority)  and  NCTAVM  (do  not  considered  themselves  as  visible  minority)  to 
refer  to  the  two  sub-groups  which  were  separated  by  Question  11,  Part  2,  1996  questionnaire 
(Appendix  B). 
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The  following  passages  list  significant  differences  within  the  sub-groups  between  1993 
and  1996.  A p value  of  < .01  of  the  statistic  F is  considered  very  significant,  whereas  a p 
value  > .01  but  not  higher  than  .05  is  considered  moderately  significant.  That  is,  the  lower 
the  p value  the  higher  the  certainty  that  the  change  in  question  has  indeed  occurred.  In 
Tables  7B  to  7E  the  significant  changes  between  1993  and  1996  are  shaded.  However,  all 
other  p values  are  also  shown  whether  they  are  statistically  significant  or  not. 

Briefly,  Tables  7B  to  7E  provide  the  readers  with  the  means  and  p values  (regardless 
of  the  levels)  of  all  the  22  items  and  F values  are  excluded  from  these  tables.  It  is  sufficient 
to  state  that  the  smaller  the  p value  the  higher  the  F value  and  in  turn  the  higher  the  certainty 
that  the  change  really  has  occurred.  To  illustrate.  Table  7B  indicates  significant  differences 
in  responses  between  1993  and  1996  males  for  item,  “people  are  not  treated  fairly  because 
they  are  different”:  means  1993=2.31,  1996=1.81;  and  p value  .01.  This  indicates  that 
there  is  a 99%  certainty  or  confidence  that  the  change  has  really  occurred.  Unless  indicated 
otherwise  items  in  the  ANOVA  analysis  are  considered  to  be  elicited  on  a five-point 
agreement  scale  for  both  1993  and  1996  surveys.  See  Figure  2,  Section  2.3. 1.3. 

Last  but  not  the  least,  Kolmogorov-Smimov  (K-S)  normality  test  indicated  that  the 
responses  to  the  22  items  were  not  normally  distributed  in  aggregate  as  well  as  in  sub-groups 
samples.  Some  of  the  variables  (not  all)  had  a similar  variance  as  tested  by  the  Bartlett  test 
of  homogeneity  of  variance  in  both  the  aggregate  as  well  as  in  sub-groups.  But  ANOVA  is 
robust  to  assumptions  of  normality  and  homogeneity  of  variance  as  long  as  sub-group 
samples  are  relatively  bigger  and  somewhat  equal  (see  Section  2.3. 1.6).  Thus,  it  was 
deemed  not  useful  to  provide  results  of  these  two  tests  in  this  report. 
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Table  7B.  Changes  in  Seven  Items  Related  to  MiiiHmnWpHiiiilHH  According  to  Seven  Sub-Groups:  Results  of  One- 

Way  ANOVA 
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Table  7C.  Changes  in  Nine  Items  Related  to  Afimagement  Dedicafiom  loOrgaaiit^iond  Openness  According  to  Seven  Sub-Groups:  RlHi 
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1.  There  is  an  overall  plan  to  deal  with  diversity  issues  in  our 
organization. 

2.  How  high  a priority  does  your  management  place  on  increasing 
organizational  openness? 

3.  There  is  commitment  to  change  at  the  top  of  the  organization. 

4.  Staff  have  created  an  open  forum  for  discussion. 

5.  There  is  adequate  training  for  staff  to  deal  with  diversity  issues 
and  needs. 

6.  Our  agency  only  thinks  of  mainstream  consumers  when  we 
advertise  our  programs. 

7.  My  organization  provides  quality  services  to  people  of  different 
backgrounds. 

8.  Staff  are  motivated  to  work  together. 

9.  Staff  know  to  whom  they  should  refer  clients/consumers  with 
specialized  needs. 

Shaded  cells  depict  significant  differences  in  1993  and  1996  means  i.e.,  F values  are  significant:  p^.Ol  depicts  a higher  level  of  certainty  in  stating  that  the  change  has  occurred;  whereas  p > .01 
but  i.05  depicts  a relatively  lower  level  of  certainty  in  stating  that  the  change  has  inde^  occurred. 


Table  7D.  Changes  in  Three  Items  Related  to  Bringing  Down  Barrkasto  Bhteg/PrmiKrting  According  to  Seven  Sub-Groups: 
#0«e-Way  ANOVA 
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2.3.2.8.1  Changes  realized  in  the  construct  Freedom  to  Speak  up  on  Sensitive 
Issues. 

All  the  seven  sub-groups  perceived  an  increased  incidence  of  “racist  remarks”  in  their 
organizations  between  1993  and  1996.  In  addition,  males,  non-managers  and  NVM  staff  also 
perceived  an  increased  incidence  in  “sexist  remarks”.  But  only  the  VM  sub-group  perceived 
that  in  1996:  the  “staff  was  more  confused  about  how  to  communicate  with  people  just 
because  they  appeared  different”,  “their  co-workers  need  to  be  more  understanding  of  how 
people  in  minority  groups  feel”  and  “there  is  conflict  when  diversity  issues  are  raised  in  their 
organization”  (Table  7B). 

The  results  of  two-way  ANOVA  indicates  the  following: 

■ Regarding  the  non-manger  subgroup  there  is  no  group  by  gender  effect  (p=.97)  and 
also  there  is  no  significant  group  by  gender  interaction  ^=.59)  concerning  the  item: 
“I  hear  racist  remarks  in  my  organization”.  Thus  it  is  unfikely  that  the  increased 
incidence  of  “racist  remarks”  reported  by  1996  non-manager  sub-group  is  due  to  a 
comparitively  higher  percentage  of  females  in  this  sub-group  (in  1993  male  non- 
managers=41  vs.  female  non-managers =231;  and  in  1996  m^e  non-managers =28 
vs.  female  non-managers =135  ). 

■ Similarliy,  regarding  the  manager  sub-group  there  is  either  no  significant  group  by 
gender  effect  (p=.19)  nor  group  by  gender  interaction  (p=.48)  concerning  the 
item:  “I  hear  racist  remarks  in  my  organization”.  Thus,  the  change  in  the  score 
between  1993  and  1996  concerning  this  item  relates  solely  to  the  respondents’  role  as 
managers. 


2.3.2.8.2  Changes  realized  in  the  construct  Management  Dedication  to. 

Organizational  Openness. 

Reported  by  the  VM  sub-group. 

Compared  to  the  other  six  sub-groups,  the  VM  sub-group  did  not  report  statistically 
significant  differences  (i.e.,  no  change  in  the  mean  scores)  between  1993  and  1996  with 
respect  to  any  of  the  nine  items  measuring  Management  Dedication  to  Organizational 
Openness.  Statistically  significant  higher  mean  scores  for  any  or  all  of  the  eight  items 
(except  item  6 which  correlated  negatively  with  the  factor)  in  1996  compared  to  1993  would 
have  suggested  that  the  VM  sub-group  perceived  a noticeable  increase  in  Management 
Dedication  to  Organizational  Openness  (Table  1C). 

In  1993  aU  seven  groups  (including  VM)  had  similar  mean  scores  for  the  nine 
items.  In  the  impact  assessment  (1996),  this  sub-group  did  not  significantly  change  their 
views  about  management  dedication  to  organizational  openness;  whereas,  the  other  six  sub- 
groups (5  staff  and  board)  reported  a significant  increase  in  management  dedication  to 
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organizational  openness  since  the  baseline  assessment.  A case  in  point,  while  all  the  other 
staff  sub-groups  reported  a change  (for  the  better)  in  the  “quality  of  service  to  diverse  clients” 
and  of  “overall  plan  to  deal  with  diversity  issues”  between  1993  and  1996,  the  visible 
minority  did  not  report  a similar  change  during  this  time  period.  For  the  VM  sub-group  the 
p values  for  the  above  items  were  .07  and  .16  respectively  (Table  7C). 

Reported  bv  the  NVM  sub-group. 

This  sub-group  perceived  Management  Dedication  to  Organizational  Openness  to  be 
higher  in  1996  than  it  was  in  1993.  For  instance,  in  1996  the  sub-group  agreed  significantly 
more  strongly  with  five  items  dealing  with  the  “overall  plan  for  openness”,  “the  existence  of 
an  open  forum  to  discuss  diversity  issues”,  “training  for  the  staff  around  diversity  issues”, 
“quality  of  service”  and  “staff  know  to  whom  they  should  refer  clients/consumers  with 
specialized  needs”.  Lx)gically,  the  sub-group  also  reported  a lower  level  of  agreement  in 
1996  with  the  item,  “our  agency  thinks  only  of  mainstream  consumers  when  advertising  our 
programs”  (Table  1C). 

Reported  by  the  Manager  mbrgrQup. 

This  sub-group  perceived  that  Management  Dedication  to  Organizational  Openness  in 
1996  was  higher  than  it  was  in  1993.  The  1996  managers  agreed  significantly  more  strongly 
with  four  items  dealing  with  the  (Table  1C): 

■ “overall  plan  for  openness”; 

■ “open  forum  to  discuss  diversity  issues”; 

■ “training  for  the  staff  around  diversity  issues”;  and 

■ “quality  of  service”. 

This  sub-group  agreed  less  strongly  with  the  item,  “our  agency  thinks  only  of 
mainstream  consumers  when  advertising  our  programs”.  In  1996,  the  perspective  of  this 
sub-group  is  similar  to  all  other  sub-groups  except  for  the  VM  sub-group  (Table  1C). 

Results  of  the  two-way  ANOVA  suggests  the  above  changes  had  occurred  regardless 
of  the  gender  composition  of  the  sub-group,  both  in  1993  and  1996.  Also,  there  was  no 
interaction  between  the  sub-group  and  gender  which  would  explain  the  results,  i.e.,  there 
was  not  significant  gender  effect  and  group  by  gender  interaction  (Table  7F).  But  there  was 
statistically  significant  group  by  group  effect  for  all  the  four  above  items  (they  are  shaded  in 
Table  7F). 
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Table  7F.  Gender  Effect  and  Group  (Manager)  by  Gender  Interaction: 
Results  of  Tlie  TwchWay  ANOVA 


Item 

Group  by 
Group 
Effect 

Group  by 
Gender 
Effect 

Group  by 
Gender 
Interaction 

• There  is  an  overall  plan  to  deal  with  diversity  issues. 

.78 

.50 

• Staff  have  created  an  opra  forum  for  discussion. 

M 

.66 

.73 

• There  is  adequate  training  for  staff  to  deal  with  diversity 
issues  and  needs. 

W^: 

.96 

.75 

• My  organization  provides  quality  services  to  people  of 
diverse  backgrounds. 

ii 

.88 

37 

Note:  There  were  a higher  numbers  of  females  than  males  in  both  1993  and  1996  mananger  sub-groups:  1996  - 
males=17  vs.  female=41;  1993  - male=27  vs.  female=68. 


Reported  b\  the  Non-Mana2ers  sub-group. 

This  sub-group  perceived  that  Management  Dedication  to  Organizational  Openness  in 
1996  was  higher  than  it  was  in  1993.  The  1996  non-managers  agreed  significantly  more 
strongly  with  four  items  dealing  with  (Table  7C): 

■ “overall  plan  for  openness”; 

■ “open  forum  to  discuss  diversity  issues”; 

■ “training  for  the  staff  around  diversity  issues”;  and 

■ “quality  of  service”. 

The  female  sub-group  also  agreed  significantly  more  strongly  with  the  above  four 
items  between  1993  and  1996.  The  results  of  two-Way  ANOVA  indicates  that  changes  in 
the  non-manager  sub-group  were  not  influenced  by  respondents’  gender,  i.e.,  these  changes 
would  have  happened  regardless  of  the  gender  make-up  of  the  two  (1993  and  1996)  non- 
manager sub-groups.  Table  7G  also  indicates  that  for  all  of  the  above  items,  there  was  only 
group  by  group  effect  (the  shaded  column)  and  no  gender  by  group  or  gender  and  group 
interaction. 
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Table  7G.  Gender  Effect  and  Group  (Non-manager)  by  Gender  Interaction: 
Results  uf  tbe  ANOVA 


Item 

Group  by 
Group 
Effect 

Group  by 
Gender 
Effect 

Group  by 
Gender 
Interaction 

• There  is  an  overall  idan  to  deal  with  diversity  issues. 

m 

.12 

.76 

• Staff  have  created  an  open  forum  for  discussion. 

H 

.67 

.90 

• There  is  adeguate  training  for  staff  to  deal  with  diversity 
issues  and  needs. 

li 

.16 

.14 

• My  organization  provides  quality  services  to  people  of 
diverse  backgrounds. 

H 

.93 

.41 

Note:  There  were  a higher  numbers  of  females  than  males  in  both  1993  and  1996  non-mananger  sub-groups: 
1996  - male=41  vs.  female=135;  1993  - male— 41  vs.  female=231. 

In  addition,  according  to  the  results  of  one-way  ANOVA,  non-managers  perceived  a 
statistically  significant  decrease  in  the  level  of  “commitment  at  the  top  of  the  organization” 
between  1993  and  1996.  However,  two-way  ANOVA  produced  a non-significant  (p=.61) 
change  in  the  score  of  this  item  between  1993  and  1996  non-managers.  This  may  be  due  to 
the  reduction  in  sample  sizes  of  the  two  non-managers  groups  in  two-way  ANOVA  compared 
to  one-way  ANOVA.  Thus  the  evaluators  did  not  present  the  p values  related  to  the  gender 
effect  and  the  interaction  between  the  group  effect  and  gender  effect  (even  though  these  were 
statistically  non-significant). 

Reported  bv  the  Male  sub-sroup. 

This  sub-group  perceived  that  Management  Dedication  to  Organizational  Openness  in 
1996  was  higher  than  it  was  in  1993:  The  1996  males  (compared  to  1993  males)  agreed 
significantly  more  strongly  with  four  items  dealing  with  (Table  1C): 

■ “overall  plan  for  openness”; 

■ “open  forum  to  discuss  diversity  issues”; 

■ “training  for  the  staff  around  diversity  issues”;  and 

■ “quality  of  service”. 

This  sub-group  agreed  less  strongly  with  the  item,  “our  agency  thinks  only  of 
mainstream  consumers  when  advertising  our  programs” . 

Note,  this  sub-group  has  reported  same  or  similar  changes  as  the  managers  sub-group 
described  above. 
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Reported  bv  Female  sub-eroup. 

This  sub-group  perceived  that  Management  Dedication  to  Organizational  Openness 
was  higher  in  1996  than  it  was  in  1993.  The  1996  female  sub-group  agreed  significantly 
more  strongly  with  four  items  dealing  with  the  (Table  1C): 

■ “overall  plan  for  openness”; 

■ “open  forum  to  discuss  diversity  issues”; 

■ “training  for  the  staff  around  diversity  issues”;  and 

■ “quality  of  service”. 

Reported  bv  the  Board  sub-group. 

Board  respondents  perceived  that  the  management  dedication  to  openness  was  higher 
in  1996  compared  to  1993.  In  1996  the  board  agreed  more  strongly  with  the  following  items 
(Table  1C): 

■ “there  is  an  overall  plan  to  deal  with  diversity  issues”; 

■ “my  organization  provides  quality  service  to  people  from  diverse 
backgrounds”;  and 

■ “there  is  commitment  at  the  top  of  the  organization”. 

2.3.2.8.3  Changes  realized  in  the  construct  Brinmng  Down  Barriers  to 

Hiring/Promotine. 

All  the  seven  sub-groups  have  shown  interest  in  bringing  down  barriers  to  hiring  and 
further  promotion.  In  1996  males  agreed  less  strongly  with  two  items  (Table  7D): 

■ “I  will  have  difficulty  being  supervised  by  someone  from  an  ethnic  group 
different  from  my  own”;  and 

■ “I  will  have  difficulty  being  supervised  by  someone  from  the  opposite  sex”. 

In  1996  females  and  NVM  agreed  less  strongly  with  the  item,  “I  will  have  difficulty 
worldng  with  people  whose  sexual  orientation  is  different  from  my  own”. 

2.3.2.5.4  Changes  realized  in  the  construct  Personal  Dedication  to  Ormnizational 

Openness. 

There  were  no  statistically  significant  changes  between  1993  and  1996  in  the 
responses  to  three  items.  Perhaps  there  was  nothing  that  respondents  felt  needed  to  change. 
Note  that  in  1993  the  mean  values  for  the  three  items  measuring  the  construct  are:  “How 
high  a priority  do  you  place  on  increasing  organizational  openness?”  (mean  range  93=3.73 
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to  3.82);  “Opening  up  the  organization  will  make  my  job  more  secure”  (mean  range  93  = 
3.08  to  3.51);  “I  am  too  busy  doing  my  regular  work  to  deal  with  the  openness  issues”  - 
mean  range  93  = 1.79  to  2.26  (Table  7E). 


2.3.2.9  MOC’s  Impacts  on  Organizational  Relationships 
Impact  Question  6 

What  is  the  change  in  the  relationship  between  selected  pairs  of  sub-groups  in 
dealing  with  diversity  issues  between  1993  and  1996  (e.g.,  is  there  a change  in 
how  i^es  and  females  or  managers/non-managers  relate  to  each  other  in  1996 
compared  to  1993)? 


Tables  8 A to  8D  presents  results  of  series  of  One-Way  ANOVA  tests  conducted  to 
determine  changes  realized  by  the  following  four  dyads:  Male/Female,  Manager/Non- 
manager, VM/NVM  and  Board/Staff  between  1993  and  1996.  Briefly,  each  table 
represents  a construct  (e.g.,  Table  8 A deals  with  changes  in  four  dyads  concerning  the 
construct  Freedom  to  Speak  up  on  Sensitive  Issues).  Note,  unless  otherwise  indicated  the 
items  reported  in  this  section  are  considered  to  be  elicited  by  a five-point  agreement  scale 
(“strongly  agree”  =5  and  “strongly  disagree”  = 1)  (Figure  2,  Section  2.3. 1.3). 

The  four  columns  contain  statistical  information  about  the  four  dyads.  As  an 
illustration,  in  Table  8A,  in  1996  for  item  1,  “there  is  confusion  about  how  to  communicate 
with  people  who  appear  different”  the  VM  sub-group  scored  higher  (or  agreed  more 
strongly)  compared  to  NVM  (p=.04):  VM  mean =2.75  and  NVM  mean =2.39.  On  the  other 
hand,  there  was  no  statistical  difference  between  this  dyad  on  this  issue  (or  item)  in  1993 
(p=.16).  The  evaluators  concluded  with  only  a moderate  level  of  confidence  that  a change 
had  occuired  (recall  p=.04  represents  only  a moderate  level  of  confidence).  Still  speaking 
of  the  same  item,  managers  and  non-managers  reflected  the  same  difference  among  them 
between  1993  and  1996:  1993  means  were  2.74  and  2.46  for  managers  and  non-managers 
respectively  (p=.()04);  whereas  1996  means  were  2.71  and  2.38  for  managers  and  non- 
managers respectively.  Thus,  the  evaluators  concluded  that  there  was  no  change  in  the  dyad 
(manager/non-manager)  concerning  the  item  “there  is  confusion  about  how  to  communicate 
with  people  who  appear  different”.  Change  can  happen  in  either  of  the  following  two  ways, 
significant  difference  in  1993  but  disappeared  in  1996  or  vice  versa.  Tables  8 A to  8D 
document  the  change  as  well  as  no  change. 
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2.3.2.9.1  Changes  in  VM/NVM  dvad. 

In  1996  the  VM  agreed  more  strongly  (than  NVM)  with  the  four  items  measuring  the 
Freedom  to  Speak  up  on  Sensitive  Issues  construct  (Table  8A). 

■ “There  is  confusion  about  how  to  communicate  with  people  who  appear 
different”; 

■ “People  not  treated  fairly  because  they  appear  different”; 

■ “My  co-workers  need  to  be  more  understanding  of  how  people  in  minority 
groups  feel”;  and 

■ “There  is  conflict  when  diversity  issues  are  raised  in  our  organization”. 

In  the  case  of  Management  Dedication  to  Organizational  Openness M 1996  the  VM 
sub-group  (compared  to  the  NVM  sub-group)  reported  a higher  agreement  with  the  item, 

“our  agency  thinks  only  of  mainstream  consumers  while  advertising  for  their  programs  and 
services”  and  scored  lower  (compared  to  the  NVM)  with  the  item,  “staff  are  motivated  to 
work  together”.  Lastly,  in  1996  the  visible  minority  sub-group  (compared  to  the  NVM  sub- 
group) placed  a “higher  personal  priority  on  increasing  organizational  openness.  ” This 
difference  in  perception  was  not  evident  in  the  base-line  survey  (Table  8D). 

2.3.2.9.2  Chan2es  in  Females/Males  dvad. 

In  1996,  females  (compared  to  1996  males  as  well  as  1993  females)  were  significantly 
less  inclined  to  “work  with  male  supervisors  and  bosses”  (Table  8C). 

2.3.2.9.3  Changes  in  Managers/Non-managers  dvad. 

On  the  subject  of  Freedom  to  Speak  up  on  Sensitive  Issues,  in  1993  managers  agreed 
more  strongly  than  non-mangers  with  items  such  as,  “I  hear  racist  remarks  in  my 
organization”  and  “I  hear  sexist  remarks  in  my  organization”  (Table  8A). 

In  1993  non-managers  agreed  more  strongly  with  two  Management  Dedication  to 
Organizational  Openness  related  items  including  (Table  8B): 

■ “My  organization  provides  quality  services  to  people  of  different 
backgrounds”;  and 

■ “Staff  are  motivated  to  work  together”. 

The  above  statistically  significant  differences  disappeared  in  1996.  In  1993  managers 
agreed  more  strongly  with  the  item  “our  agency  only  thinks  of  mainstream  consumers  when 
we  advertise  our  programs”.  This  difference  disappeared  in  1996  (Table  8B).  Lastly,  in 
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1996  the  managers  agreed  more  strongly  with  the  item,  “there  is  commitment  to  change  at 
the  top  of  the  organization”.  This  difference  was  not  discemable  in  the  1993  computation. 

2.3.2.9.4  Changes  in  Staff/Board  dvad. 

This  dyad  changed  in  two  fundamental  items/issues:  “my  organization  provides 
quality  services  to  people  of  different  backgrounds”  and  “people  are  not  treated  fairly 
because  they  appear  different”.  These  two  items  relate  respectively  to  the  constructs, 
Management  Dedication  to  Organizational  Openness  and  Freedom  to  Speak  up  on  Sensitive 
Issues. 

In  1996  the  board  agreed  more  strongly  than  the  staff  with  the  item, “my  organization 
provides  quality  services  to  people  of  different  backgrounds”.  In  1993  there  was  no 
significant  difference  in  perception  on  this  issue. 

On  another  critical  issue  the  perception  gap  closed.  In  1996  the  staff  and  board 
perceived  similarly  (scored  similarly)  on  the  item,  “people  are  not  treated  fairly  because  they 
appear  different”.  In  1993  the  staff  agreed  significantly  higher  than  the  board. 
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Table  8A:  Ways  Four  Dyads  Changed  Between  1993  and  1996  Concerning  the  Construct 


t'S 

C ’O 

c i 


« -c 

•g)s 

•Sr  4> 
J5  -O 
ea  w 
2 C 

li 

•o  2 


o.'l 

i 3 


g-s 


> s 

CL 

r o 

•-f 

ss  « 

6 g 

NO  'O 

as 


« .5 

SI 

c « 


ii 

(-4 

Sc  «> 

^ I 


« > 

11 
•s  2 


*5-2 
^.2 
^ a, 

CD  O 

•S® 

^ VI 


MOC’s  Description  & Impacts  Page  116 


Table  8A.  Ways  Four  Dyads  Changed  Between  1993  and  1996  Concerning  the  Construct 
(ConCd) 


« a 


llal 

« a 


ill  I 


siP 

ml 


ipl 


S SE&«.S 


i 1 

•""1  .1 


Chi  2;; 


5!  a 

« 11 
<s  o« 


^ 31 


S p 

n II 


i ® 

II 


% 

^ fl’5 


ili 

3 S. 


i s 

•«  II 


•«  II 

fti 


*n  II 

R< 


SZ? 

WJ  II 


§ 

m II 


.2  c 


S? 

i5| 


s 7 


Se 


; II 


sj  ^ 

oS  • 
•«  n 


I 

CO 

2!5 


.5  o 
« a 

**  O 

S >% 

Vi 

il 

0.2 

I’i 


o| 


5 . 
.11 
II 

.s  g 

^ oa 

.S  2 


^•c 

."la 


fi 

C8  U 
O u 

« 5 


“ >0 
2.S 


4>  .S 
2,  o 

>1 

U<.c 

11 

c u 


o\  2 


SI 


00  o 
«>  -I 

11 

II 

s.^ 

BO  es 
2 


= « 
TJ-o 

*2^ 


MOC’s  Description  & Impacts  Page  117 


Table  8B.  Ways  Four  Dyads  Changed  Between  1993  and  1996  Concerning  the  Construct  Mana^;ement  Dedication  to 
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Shaded  cells  depict  significant  differences  in  1993  and  1996  means  i.e.  F values  are  significant:  p^.Ol  depicts  a higher  level  of  certainty  in  stating  that  the  change  has  occurred;  whereas  p > .01 
but  ^ .05  depicts  a relatively  lower  level  of  certainty  in  stating  that  the  change  has  indeed  occurred.  Statements  describing  the  changes  are  also  shaded.  (Continued) 


TaJjile  |B.  Wa^  Four  Dyads  Changed  Between  1993  and  1996  Concerning  the  Construct 


11 


rS 

•^1 

I 

I 2 


ja  oti 

l| 


S-i 
>0  2 


"I 
s i 

o o 
•^1 


S ” 

E M 

VO  .S 
§:  2 


* 5* 
tn  c 

SI 


2" 

is 

li 

11 
®®2 
*”  2 
.2  « 
§-2 
•0.2 
£ S' 

TS-o 

«w^ 


fl 


Table  8C.  Ways  Four  Dyads  Changed  Between  1993  and  1996  Concerning  the  Construct  Bringing  Down  Barrlcars  to  Hiring/j 
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Table  8D.  Ways  Four  Dyads  Changed  Between  1993  and  1996  Concerning  the  Construct 
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2.3.2.10.  Overall  Attitudinal  Changes  in  Participating  Agencies 
Impact  Question  7 

How  have  the  fourteen  agencies  changed  between  1993  and  1996? 


While  answers  to  impact  questions  5 and  6 help  describe  changes  in  sub-groups  as 
well  as  selected  dyads,  they  fail  to  provide  any  information  about  the  type  of  changes  which 
took  place  within  individual  agencies.  The  evaluators  asked:  What  changes  manifested  in  the 
agency  “A”  between  1993  and  1996.  Only  nine  out  of  the  14  agencies  had  staff  sample 
sizes  adequate  enough  to  conduct  such  an  analysis. 

The  following  paragraphs  briefly  describe  changes  as  reported  by  staff  of  nine 
agencies,  in  Management  Dedication  to  Organizational  Openness,  Freedom  to  Speak  up  on 
Sensitive  Issues,  Bringing  Down  Barriers  to  Hiring/ Promoting  and  personal  dedication  to 
openness  within  the  nine  agencies. 

2.3.2.10.1  Construct  1.  Freedom  to  Speak  up  on  Sensitive  Issues, 

To  measure  agency-specific  changes  related  to  this  construct  the  evaluators  focused  on 
only  three  (out  of  seven)  items/questions  dealing  with:  “the  incidence  of  racist  remarks”, 
“incidence  of  sexist  remarks”  and  “treatment  of  staff  based  upon  their  appearances”. 

Agency-specific  data  revealed  that  staff  of  five  agencies  did  not  witness  any 
significant  changes  (neither  increase  nor  decrease)  in  frequency  of  “racist  and  sexist 
remarks”  as  well  as  “treatment  of  their  colleagues  based  on  their  appearances”  between  1993 
and  1996.  Another  two  agencies  reported  an  increase  in  “noticing”  that  their  colleagues  are 
treated  differently  (unfairly)  based  on  their  appearances  (e.g.,  colour,  disability)  between 
1993  and  1996.  One  out  of  the  remaining  two  agencies’  data  revealed  that  their  staff  have 
“noticed”  a significant  increase  in  all  of  the  three  events  between  1993  and  1996.  Lastly,  the 
staff  of  the  remaining  agency  report  an  increased  incidence  of  racist  and  sexist  remarks  in 
their  organization. 


Evaluators  are  not  free  to  divulge  agency  names  and  characteristics.  Information  about 
agency-specific  changes  was  provided  to  the  14  agencies  individually. 
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2.3.2.10.2  Construct  2:  Manaeement  Dedication  to  Organizational  Openness. 

To  measure  agency-specific  changes  related  to  this  construct  the  evaluators  focused  on 
only  three  (out  of  nine)  items/questions  dealing  with:  “level  of  management  priority  to 
openness”,  “commitment  to  change  at  the  top  of  the  organization”  and  “training  for  the 
stafr. 

Staff  of  three  agencies  reported  that  there  were  no  significant  changes  in  Management 
Dedication  to  Organizational  Openness  in  their  respective  agencies,  i.e.,  the  mean  score  of 
the  three  items  remained  virtually  the  same  between  1993  and  1996.  Another  four  agencies 
reported  a significant  increase  in  staff  training  between  1993  and  1996.  One  of  these  four 
agencies  also  reported  an  “increase  in  management  priority  to  openness”  between  1993  and 
1996.  Interestingly,  the  remaining  two  agencies  reported  a significant  decrease  in 
“commitment  to  openness  at  the  top”  and  the  “management  priority  to  organizational 
openness”. 

2.3.2.10.3  Construct  3.  Bringing  Down  Barriers  to  Hiring/Promoting, 

To  measure  agency-specific  changes  related  to  this  construct  the  evaluators  focused  on 
only  one  (out  of  three)  item/question  dealing  with:  “level  of  difficulty  being  supervised  by 
someone  from  a different  ethnic  background”. 

In  1996  the  staff  of  three  agencies  confirmed  their  original  beliefs  (revealed  in  the 
1993  survey)  that  they  would  not  have  difficulty  having  a supervisor  with  a different  ethnic 
background  from  their  own.  The  rest  (six  agencies)  did  not  change  their  scores  (therefore 
their  position)  about  this  item  between  1993  and  1996.  Their  position  in  the  baseline 
assessment  was  that  they  would  not  have  any  difficulty  having  a supervisor  from  a different 
ethnic  background. 

2.3.2.10.4  Construct  4.  Personal  Dedication  to  Organizational  Openness. 

To  measure  agency  specific  changes  related  to  this  construct  the  evaluators  focused  on 
only  one  (out  of  three)  item/question  dealing  with:  “level  of  personal  priority  to  openness”. 

Agency-specific  data  revealed  that  none  of  the  nine  agencies’  staff  reported  a 
significant  change  (neither  increase  or  decrease)  in  level  of  personal  priority  to  openness 
between  1993  and  1996.  These  nine  agencies  reported  a relatively  high  level  of  personal 
priority  to  organizational  openness:  range  of  mean  scores  = 3.59  to  4.15. 
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2.3.2.11  MOC’s  Impacts  on  Staff  and  Board  Compositions 
Impact  Question  8 


Did  the  MOC  project  influence  participating  agencies  to  diversify  their  staff  and 
board  members? 


I 


There  have  been  no  discemable  changes  in  the  staff  mdi  board  demographic  composition 
between  1993  and  1996  based  on  respondents’  gender,  level  of  formal  education,  spoken  and/or 
written  languages,  age,  religion,  perceived  visible  minority  status,  ethnic  backgrounds  and 
length  of  time  in  Canada  (see  Tables  C-1  to  C-7,  Appendix  C). 


2.3.2.12  MOC’s  Impacts  on  Consumers’  Compositions 

Impact  Question  9 


Did  the  MOC  project  influence  participating  agencies  to  diversify  their 
consumers/clients  (are  more  diverse  clients  accessing  the  services  offered  by 
the  agencies?) 


Board  and  staff  respondents  reported  that  selected  programs  have  more  diverse 
(“somewhat  diverse”  and  “much  more  diverse”)  consumers  in  1996  compared  to  1993.  The 
fourteen  agencies  report  that  their  programs  and  services  have  become  anywhere  from  14  to 
35  % more  diverse,  depending  upon  which  of  the  nine  diversity-related  characteristics  one  is 
focussing:  age  distribution  (28%),  gender  ratio  (18%),  income  distribution  (14%),  family 
makeup  distribution(l 4%),  first  language  distribution  (30%),  race/ethnicity  distribution  (35%), 
ability /disability  distribution  (20%),  sexual  orientation  distribution  (18%),  religion/spirituality 
distribution  (19%)  (Table  9A). 

It  is  of  note  that  among  the  nine  diversity  characteristics,  between  40%  and  60%  of  staff 
were  unable  to  make  an  assessment  of  the  change  in  the  demographics  of  the  participation  in 
their  programs  during  the  time  period  (Table  9A). 

The  reason  why  some  programs  and  services  were  more  diverse  in  1996  than  in  1993 
are:  a)  external  factors  - notably  the  availability  of  funding,  socio-economic  forces  and 
demographic  changes  in  the  communities  being  served;  b)  internal  factors  - notably  changes  in 
attitudes  philosophy,  outreach/referral  practices  and  program  changes. 

The  reasons  why  some  programs  and  services  did  not  and  could  not  change  is  because 
the  program  is  tied  to  a specific  target  group  like  teenage  mothers  or  recipients  of  unemployment 
benefits  (Table  9B).  The  available  data,  however,  does  not  allow  the  evaluators  to  determine 
whether  or  not  the  hypothetical  program  for  teenage  mothers  is  accessible  to  all  teenage  mothers 
irrespective  of  other  factors  (e.g.,  ethnicity,  income). 
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Table  9A.  Demographic  Changes  in  Consumer  Profile  from  1993  to  1996  as  Observed  by  Staff 


Demographic  Characteristics 

Frequencies 

Change  Scale 

n =258 

Mode 

1 

2 

3 

4 

5 

6 

Age  Compositioii 

0 

1 

77 

54 

19 

107 

3 

0.4% 

30% 

21% 

7% 

41% 

Gender  Ratio 

1 

4 

97 

38 

7 

111 

3 

0.4% 

2% 

38% 

15% 

3% 

43% 

Income  Levd  Composition 

0 

20 

86 

34 

3 

115 

3 

8% 

33% 

13% 

1% 

45% 

Family  Makeup  Composition 

0 

4 

89 

32 

6 

127 

3 

2% 

35% 

12% 

2% 

49% 

First  Language  Composition 

1 

4 

60 

58 

18 

117 

3 or  4 

0.4% 

2% 

23% 

23% 

7% 

45% 

Race/Ethnicity  Composition 

0 

3 

52 

71 

17 

115 

4 

1% 

20% 

28% 

7% 

45% 

Ability/disability  Composition 

0 

4 

82 

43 

7 

122 

3 

2% 

32% 

17% 

3% 

47% 

Sexual  Orientation  Composition 

0 

1 

57 

40 

5 

155 

3 

0.4% 

22% 

16% 

2% 

60% 

Rdigion/Sptrituality  Composition 

0 

2 

48 

45 

5 

158 

3 

1% 

19% 

17% 

2% 

61% 

Key:  1 = "Much  Less  Diverse  Now";  2 = "Somewhat  Less  Diverse  Now";  3 = "Same  As  Before";  4 = 
"Somewhat  More  Diverse  Now";  5 = "Much  More  Diverse  Now" 
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Table  9B:  Why  Did  Consumer  Populations  Change  or  Not  Change:  Reasons  Given  by  the  Staff  and  Board  in  1996  Survey 


1 

u 
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Table  9B.  Why  Did  Consumer  Populations  Change  or  Not  Change:  Reasons  Given  by  the  Staff  and  Board  in  1996  Survey  (Cont’d) 
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2.3.3  Discussion 


This  section  is  organized  under  each  of  the  nine  impact  questions  outlined  previously 
(Section  2.3. 1.1).  The  nine  impact  questions  represent  two  types  of  inquiries:  direct  and 
indirect.  The  first  four  questions  contribute  to  the  direct  inquiry  because  they  elicited 
information  that  can  be  directly  linked  to  the  MOC  project^®.  Questions  5 to  7 contribute  to 
the  indirect  inquiry  because  the  findings  cannot  be  linked  directly  to  the  MOC  project. 

These  22  items  were  neither  time-framed  nor  connected  to  the  MOC  project.  However,  the 
evaluators  attempted  to  create  a temporal  correlation  solely  based  on  the  responses  to  these 
attitudinal  items  designed  to  measure  organizational  openness  at  two  points,  1993  and  1996. 
The  discussion  is  couched  in  the  four  constructs  described  previously  in  this  report  (Section 
2. 3. 2. 3).  Lastly,  questions  8 and  9 helped  assess  changes  in  staff,  board  and  consumer 
demographics. 

The  findings  of  the  evaluation  were  discussed  in  a session  involving  a sample  of 
stakeholders  which  was  held  on  March  19,  1997  at  the  Calgary  offices  of  Alberta 
Community  Development.  This  discussion  was  conducted  in  a participatory  fashion,  a 
format  which  enabled  the  stakeholders  to  discuss  the  evaluation  findings  and  develop 
conclusions  and  implications  for  further  action.  To  assist  the  discussion  process,  an  abridged 
evaluation  findings  document  was  delivered  to  each  stakeholder  prior  to  the  workshop.  In 
addition,  the  data  analyst  on  the  team  presented  a summary  of  the  findings  to  the  group.  An 
opportunity  was  then  provided  to  the  stakeholders  to  ask  questions  about  the  process  and  the 
findings  including  statistical  tests  employed. 

The  facilitators  divided  the  stakeholders  into  three  groups  composed  of  three  or  four 
stakeholders.  Each  group  was  given  findings  of  two  of  the  impact  questions  for  an  in-depth 
discussion.  Each  group  was  given  the  following  four  questions  to  guide  their  group 
discussion. 

1.  What  are  the  essential  “messages”  posed  by  the  findings  for  each  Impact  Question? 

2.  When  these  messages  are  strung  together,  what  do  they  tell  us  in  answering  the 
Impact  Questions?  (Synthesis) 

3.  What  are  the  implications  of  these  insights  on  future  policies  and  practices? 

4.  Do  you  have  any  stories  or  examples  that  reinforce  these  insights? 


Responses  to  the  four  open-ended  questions  (Ic,  2c,  3c  and  4c,  Section,  D)  in  the  1996 
survey  (Appendix  B)  were  accepted  as  valid  (i.e.,  face  validity).  No  attempt  was  made  to  assess  the 
trustworthiness  of  the  responses. 
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The  following  pages  provide  theoretical  and  experiential  support  to  the  evaluation 
findings.  Material  for  the  discussion  section  has  been  extracted  directly  from  the  stakeholder 
workshop  and  from  an  in-depth  discussion  among  the  evaluators.  Findings  considered  too 
vague  or  obscure  have  been  included  for  the  sake  of  completeness,  but  without  explanation  or 
attribution.  The  implications  (e.g.,  for  policy,  training,  evaluation)  of  the  evaluation  have 
been  outlined  in  Section  2.3.4. 

2.3.3.1  MOC\S  Impacts  on  The  Organization 
Impact  Que5rtion  1 . 

How  did  the  MOC  project  influence  changes  in  the  internal  workings  of 
organizations  in  relating  to  diversity  issues? 


Half  (50%)  of  staff  mdi  60%  of  board  members  reported  that  MOC  had  a “high 
quality”  of  influence  on  the  workings  of  the  individual  agencies.  Compartively  a lesser 
(47%  for  both)  proportion  of  females  and  non-managers  considered  MOC  to  be  a “high 
quality”  change  intervention  (Table  3A,  Section  2. 3. 2. 4).  See  Section  2. 3.2. 4 for  the 
definition  of  “high”,  “medium”  and  “low”. 

Among  the  comments  related  to  the  nature  of  the  impacts,  67  % were  positive  about 
the  achievements  of  the  MOC  project  (Question  Ic,  Section  D,  Part  One  Appendix  B). 

MOC  was  praised  because  it  provided  education,  understanding  and  awareness  in  how  to  deal 
and  interact  with  people  irrespective  of  their  backgrounds,  gender,  income  levels,  sexual 
orientation,  age,  family  circumstances  and  religions/spirituality  (Table  3B,  Section  2. 3. 2. 4.). 

Speaking  of  concrete  issues,  MOC  provided  impetus  to  bringing  down  barriers  to 
hiring,  formalizing  diversity  initiatives  (drafting  policy  and  agendas  for  meetings), 
allocating  resources  to  sustain  the  process  and  lastly  to  drive  participating  agencies  to 
diversify  their  volunteer  and  staff  composition.  On  the  last  point  however,  the  staff  and 
board  composition  of  the  participating  agencies  have  remained  largely  unchanged  between 
1993  and  1996  (Section  2.3.2.11). 

The  participants  at  the  meeting  were  disturbed  (some  thought  it  was  par  for  the 
course)  to  find  out  that  MOC  had  gathered  some  criticism  and  negative  comments,  although 
these  were  fewer  in  number  than  the  positive  comments.  A total  of  12  out  148  (8%) 
comments  were  negative.  Negative  sub-themes  included:  MOC  was  a waste  of  time, 
unethical  and  felt  that  MOC  created  some  feelings  of  “reverse  discrimination”  (Table  3B, 
Section  2. 3.2. 4). 
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Another  22  out  of  148  comments  (15%)  suggested  that  MOC  had  no  influence  on  the 
working  of  their  agency.  The  remaining  15  out  of  148  (10%)  comments  reflected 
ambivalence  - MOC  left  some  respondents  hanging  midway  between  feeling  negative  and 
positive.  The  evaluators  have  termed  this  theme,  “mixed  feelings”,  to  indicate  that  some 
respondents  would  have  received  more  benefit  from  the  MOC  process  if  a few  things  and 
events  had  been  handled  differently  (Table  3B,  Section  2. 3.2. 4). 

Although  it  may  be  tempting  to  argue  that  MOC  does  not  need  to  improve,  simply 
because  MOC  gathered  more  positive  comments  than  not-so-positive  comments  (i.e.  all  the 
other  themes  put  together),  this  would  be  a mistake.  The  fear  that  MOC  may  stop  evolving 
is  unfounded.  Almost  unanimously,  participants  at  the  stakeholder  meeting  wanted  diversity 
work  to  continue  to  evolve  and  improve  so  that  it  becomes  fully  integrated  into  the  work  of 
every  organization.  It  is  unlikely  that  any  organizational  change  would  happen  without  some 
negative  comments,  and  these  can  serve  as  warning  flags  and  provide  critical  information  for 
modification  for  specific  approaches  employed  by  MOC. 


2.3.3.2  MOC^S  Impacts  On  The  Personal  Being 
Impact  Question  2. 


How  did  the  MOC  project  influence  personal  changes  in  board  and  staff 
members  in  relating  to  diversity  issues  (i.e.,  have  key  actors  acquired 
further  knowledge,  skills  and  comfort  in  dealing  with  diversity  issues)? 


Approximately  half  of  board  and  staff  felt  that  MOC  made  positive  changes  in  their 
personal  being/lives:  43%  of  staff  and  47%  of  board  reported  that  MOC  had  a “high  quality” 
of  influence  (Table  4A,  Section  2. 3. 2. 5). 

In  their  own  words  (see  Question  2c,  Section  D,  Appendix  B),  board  and  staff 
identified  three  kinds  of  MOC’s  impact  on  their  personal  being:  positive,  negative  and  in- 
between.  Table  4B  (Section  2. 3. 2. 5)  shows  that  the  majority  (69%)  of  comments  make  a 
definitive  overall  statement  about  personal  gains  made  by  the  respondents  as  a result  of  the 
MOC  project.  In  addition,  comments  which  fit  three  other  categories  emerged:  personal 
losses  (e.g.,  feeling  of  reverse  discrimination),  personally  no  gain,  no  loss  (sometimes 
phrased  as  “/'m  still  the  same"'),  and  a category  of  confused  and  mixed  feelings  (such  as, 
MOC  has  impacted  my  life  and  it  is  difficult  [because]  ...  the  agency  has  not  moved  to  the 
same  degree).  In  addition.  Table  4B  (Section  2. 3. 2. 5)  documents  specific  verbatim  examples 
under  their  respective  themes  and  sub-themes. 
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Fifty  (50%)  of  staff  and  60%  of  the  board  reported  “high”  quality  impacts  on  the 
organizational  workings,  whereas  43%  of  the  staff  and  47%  of  the  board  reported  positive 
impacts  on  their  personal  beings.  Further,  38%  (94  out  of  244)  of  the  staff  and  board  who 
reported  in  the  “high”  category  for  the  MOC’s  impacts  on  the  organization  also  reported  in 
the  same  category  for  personal  changes  as  well.  Obviously  there  is  a positive  relationship 
between  the  two  variables,  which  can  be  understood  intuitively  The  MOC  process  was 
founded  on  “a  head-heart-hand”  model.  To  some  extent  the  current  results  support  this 
model.  However,  the  above  premise  was  challenged  by  a comment  made  by  a staff 
respondent.  It  indicated  that  it  is  possible  to  follow  the  lead  of  the  organization  blindly 
without  personally  believing  the  philosophical  underpinning  of  the  process.  However,  the 
same  comment  continued  to  clarify  that  there  are  limits  to  such  a conformist  behaviour. 

Some  feel  that  in  any  organizational  change  process  it  is  imperative  to  look  at  the  four 
quadrants  simultaneously:  structure,  systems/process,  culture  and  individual 

The  stakeholders  group  did  not  discuss  these  findings  in-depth.  Nevertheless,  this 
information  has  implications  for  how  to  plan,  deliver  and  implement  an  intervention  such  as 
MOC.  How  should  a diversity  initiative  begin?  What  is  effectiveness  in  this  context?  Is  the 
port  of  entry  the  individual  person  or  an  individual  agency  (i.e.,  structure,  system/process 
and  culture)?  Should  the  individual  and  his/her  organization  be  simultaneously  affected? 
Given  the  complexity  of  organizations  and  the  individuals  within  them,  what  is  a reasonable 
length  of  time  that  MOC  will  require?  What  is  the  nature  of  any  resistance  to  the  changes 
which  emerge  from  the  intervention  and  what  does  this  say  about  the  kind  of  strategies  that 
are  developed  and  their  modification?  Indeed,  can  one  force  attitudinal  changes  within 
individuals  and,  is  this  kind  of  conflict  good,  useful  or  even  ethical?  These  and  many 
similar  questions  were  discussed  throughout  the  MOC  process  (including  the  planning  stage). 


The  Pearson  r coefficient  between  these  two  variable  is  .56. 

This  model  was  developed  by  Rebecca  Chan  Allen  (DLO,  Inc)  in  1994. 
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2.3.3.3  MOC^S  Impacts  On  Professioiial  Practices 

Impact  Qucstioii-l. 

How  did  the  MOC  project  influence  changes  in  professional  practices  in 
staff  members  in  relating  to  diyersity  issues? 


MOC’s  impacts  were  far  reaching,  and  the  majority  of  staff  respondents  (78%)  felt  that 
MOC  made  quite  a difference  in  their  professional  lives  (responses  ranged  from  1 to  5 - “lot  of 
difference”  end  of  the  scale).  Board  responses  were  excluded  from  this  analysis,  (see  Question 
3a,  Appendix  B):  65  % of  all  the  responses  are  concentrated  on  points  3,  4 and  5 on  the  scale. 
Non-responses  were  excluded  from  this  computation.  (See  Table  5 A,  Section  2. 3. 2. 6 for  staff 
responses  on  a 10-point  difference  scale,  l=“lot  of  difference”  and  10= “no  difference”. ) 

Analysis  of  open-ended  comments  gleaned  positive,  no  eflects  and  mixed  feelings  type 
of  comments  (see  Question  3c,  Section  D,  Part  One,  Appendix  B).  See  Table  5B  (Section 
2. 3. 2. 6)  for  the  themes,  sub-themes  and  specific  examples  along  with  the  number  of  comments 
(i.e.,  weightings)  made  under  each  theme  and  sub-theme.  A total  of  53  out  of  68  (78%) 
comments  were  positive.  Sub-themes  under  positive  comments  include: 

■ Increased  services  to  a diverse  consumer  population; 

■ Providing  the  impetus  to  make  diversity  an  area  to  learn  about  in  social  work  and 
human  services; 

■ Providing  the  impetus  to  change  educational  institutions  (e.g. , 
curriculum)  regarding  diversity  and  related  topics; 

■ Providing  the  impetus  to  change  some  aspects  of  professional 
associations; 

■ Providing  the  skiUs  to  change  (or  fine  tune)  professional  practices; 

■ Creating  more  demand  for  human  service  practitioners  with  a focus  or 
specialty  in  working  on  diversity  within  their  profession;  and 

■ Providing  the  impetus  to  interact  with  other  professionals,  i.e. , MOC 
promoted  inter-disciplinarity  and  collaboration. 

Twenty-two  percent  (22%)  of  the  positive  comments  about  the  impact  of  MOC  were 
attributable  to  the  sub-theme.  Increased  services  to  a diverse  consumer  population,  which 
suggests  that  agencies  and  their  professionals  are  interested  in  diversifying  their  consumer  base. 
In  addition,  21%  of  the  comments  relate  to  awareness/education  (Table  5B,  Section  2.3.2.6). 
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Even  though  MOC  was  designed  to  address  diversity  and  equity  within  the  context  of 
organizational  change,  it’s  impacts  (positive  as  well  as  negative)  trickled  through  professional 
conduct,  practices  and  skills.  It  is  also  important  to  note  that  the  perceptions  and  observations 
which  have  been  captured  in  the  surveys  may  only  be  espoused,  and  they  may  not  translate  into 
actual  practice  in  day-to-day  organizational  operations. 

2.3.3.4  MOC’S  Impacts  On  The  Community-at-large 
Impact  Question  4. 

Did  the  MOC  project  contribute  to  a change  in  programs  and  services  in  the 
social  service  and  health  sector  in  Calgary?  (e.g.,  are  more  diverse  people 
accessing  health  and  social  services?) 


Yes,  according  to  the  available  evidence,  MOC  did  indeed  contribute  to  a change  in 
programs  and  services  in  the  social  service  and  health  sectors  in  Calgary.  Table  6A  indicates 
that  78%  (ignoring  the  non-responses)  of  the  staff  reported  that  MOC  made  a difference  to  their 
community.  Further,  a look  at  Table  6B  indicates  that  MOC  had  a positive  effect  (more 
openness  and  more  partnerships  among  agencies,  etc.)  on  the  community-at-large  (see  Section 
2.3.2.7).  However,  it  must  be  noted  that  during  the  MOC  project  there  were  several  other 
confounding  factors  which  likely  contributed  to  the  positive  outcomes.  Some  of  these  included 
federal  and  provincial  government  policies  (including  multicultural  policies),  restructuring  and 
funding  imperatives,  curriculum  changes  in  the  training,  professional  education  and  in- 
servicing of  social  services  professionals.  In  this  context,  MOC  is  just  one  thread  of  a much 
larger  and  more  complex  diversity  tapestry.  Similarly,  the  negative  impacts  (e.g. , 
reduction  of  services,  all  issues  forgotten)  more  than  likely  were  a combined  contribution  of 
forces  beyond  MOC’s  control  (e.g.,  funding  cut  backs,  lack  of  resources,  etc.).  Nonetheless,  a 
single  direct  negative  comment  about  the  MOC  experience  such  as,  7 see  a lot  of  anger  among 
staff  of  non-profit  agencies  against  United  way”,  raises  caution  that  there  is  potential  for  a 
backlash.  At  the  same  time,  knowledge  of  the  real  and  potential  backlash  that  accompanies 
change  efforts  can  help  inform  change  strategies.  At  the  stakeholders  meeting  one  could  see 
that  some  anxiety  and  anger  had  already  dissipated  over  time. 

Approximately  half  (46%)  of  the  comments  indicated  that  MOC  helped  in  making 
positive  changes  in  Calgary’s  social  services  and  health  sector.  The  data  also  revealed  that  in 
relative  terms  MOC  impacted  organizational  workings,  personal  lives  and  professional  practices 
more  positively  than  it  did  the  community-at-large.  It  is  not  a surprise  some  respondents  were 
not  able  to  assess  or  judge  MOC’s  contribution  to  the  community-at-large,  given  the  large 
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number  of  confounding  variables  this  presents.  In  any  case,  to  realize  “full  blown”  impacts  on 
the  community  different  programs  need  to  be  developed. 


2.3.3.5  MOC^S  Impacts  On  Specific  Sub-groups 
Impact  Question  5. 

How  have  the  attitudes  of  selected  sub-groups  changed  between  1993  and  1996  in 
relating  to  diversity  issues  (e.g.,  how  have  males  changed  their  attitudes  towards 
diversity  or  how  have  managers  changed  their  attitudes  towards  diversity  between 
1993  and  19961? 


The  evaluators  determined  attitudinal  changes  among  the  six  staff  sub-groups  and  the 
board  sub-group  between  1993  and  1996.  See  Section  2.3.2. 8 for  the  characteristics  of  the  sub- 
groups, including  their  sample  sizes  in  1993  and  1996. 

The  visible  minority  sub-group  is  composed  of  staff  who  considered  themselves  to  be 
part  of  a visible  minority  cultural  group  (abbreviated  as  VM).  They  could  be  physically  and/or 
mentally  disabled/challenged  or  belonging  to  an  ethnic  minority  group.  The  sub-group  which 
did  not  identify  themselves  as  visible  minority,  is  referred  to  as  the  NVM  sub-group  throughout 
the  report. 

Overall  the  six  staff  categories  can  be  viewed  as  mutually  exclusive  pairings  (dyads)  of 
three  diversity  related  variables:  a)  gender  (male  or  female),  b)  organizational  role  and  ranking 
(manager  or  non-manager),  and  c)  perceived  status  as  a visible  minority  (visible  minority  or 
not).  These  six  staff  and  board  sub-groups  presented  an  opportunity  to  determine  changes  from 
different  vantage  points.  Because  of  the  small  sample  size,  the  board  sub-group  was  not  further 
broken  into  sub-groups  in  the  same  way  staff  sample  was.  These  seven  sub-groups  are  unique 
in  their  compositions.  Nonetheless,  evaluators  took  care  in  statistically  ruling  out  the  influence 
or  effect  of  a potentially  confounding  variable  while  investigating  a particular  variable 

Generally  speaking,  at  least  two  issues  touched  in  this  evaluation  (gender  and 
ethnic/racial  issues)  have  been  the  subject  of  legislation  and  debate  throughout  Canada.  One’s 
position,  role  and  ranking  in  the  organization  is  a critical  diversity  element  when  combined  with 
one’s  gender,  race  and  minority  status. 

The  following  is  an  account  of  how  the  various  sub-groups  changed  their 


To  illustrate,  4ie  evaluators  statistically  ruled  out  gender  effect  and  interaction  (by  means  of  a 
2 way  ANOVA  analysis)  while  determining  changes  in  the  non-manger  sub-group,  because  there  was  a 
preponderance  of  females  in  both  the  1993  and  19%  samples. 


MOC’s  Description  & Impacts  Page  134 


iM 


^Hp“  <u  1^ 


iii. 


W?.^' 


'W'  -S.  V 


&ffa  €^I  o»»«t>d  Iwsaaito 

ib-riiRt*  ’''*«iii;«-*t>4l  fo»s»fiis&»''JBl»  Asw  ^ 

y*ir»S»a&  ifrigWftf2-*ii«»M»«  ‘8l*i^ll!8^«i»ffS»5!^^-^^^  *;.■: 

^ T®  ri* 


5«<i  bf  ft  *q(nns<5»«  'a«sf  3tHi  ai 

i^'ic  wiiit  iaia!3aiGm$*-^  <icil%.l.J'i'S 


id  '<!  i'«vfeyj«yti  bgtaMiam 

’ BT  . a '■'S^ 


tw 


Sfliabff!  tm  tMm  (s  : 


XI 


Mm.^ 

J • I!  9?tixniJtbtr  ^ 

•K.^.-ioi  h^tnmf^ 

^piMV  $*M  *Q*  - »ijv  J«S  ,.|1®TT  '.^SN^wgMiif,  ■"-:*.**««*«  ,s««d  .?si*  jl'l 

«K><«lla4  aai  iiTto  v«ic>dito8  |ii 

btu  ziLiaigi  0 ,,  ' 

<'4bC*  aUnsS  :ijfldw»-i»c«-  Mini!ii^  01fsl::  y/«^i»ad  ^I'nul  <w«s«  Iiba«^6teJ^ 

ifeiw.  ‘•y-Kifoco  i".j<fe-;.-;o.  V,'/  ;;;r8Tsv*?»  kanm  ft  »f  wotoestaK^fc  5«ltSS  ,tx 

■ '1 . 

It  ’ I*  i t*i  ,^3  <!i*8  iffcKiJ? .^v  flwij  #c^  a«  al 


alfi  ^ . ; ffl>  twit  ,:'<| 

a ijw  ar-^  jcri  iiaysitib  (afe'^fuptA  aVO^’^ 

* hOB  i^ltd  If/SUsM  % 


attitudes/perception  around  the  four  altitudinal  constructs  between  1993  and  1996.  See  Tables 
7B  to  7E,  Section  2. 3. 2.8  for  the  magnitude  and  direction  of  change  associated  with  each  sub- 
group. 


2.3.3.5.1  Construct  1:  Freedom  to  Speak  up  on  Sensitive  Issues. 

AU  seven  sub-groups  perceived  an  increased  incidence  of  “racist  remarks”  in  their 
organizations  between  1993  and  1996;  whereas  only  three  sub-groups  (male,  non-manager  and 
NVM)  witnessed  an  increase  in  the  incidence  of  “sexist  remarks".  Two  possible  reasons  for  the 
higher  incidence  of  what  constitutes  both  “racist”  and  “sexist  remarks”  in  1996  are: 

a.  There  has  been  an  actual  increase  (in  quantitative  terms)  in  racist  and  sexist 
remarks  in  the  participating  agencies; 

b.  There  has  been  an  increased  awareness  of  both  racist  and  sexist  remarks. 

Why  should  all  the  sub-groups  perceive  an  increase  in  “racist  remarks”  compared  to 

“sexist  remarks”  between  1993  and  1996?  One  stakeholder  provides  three  possible  reasons  to 
explain  the  finding: 


To  date,  as  a society,  we  are  more  aware  of  sexist  comments  than  racist 
comments.  Knowledge  and  experience  of  sexism  is  more  developed  and  has 
been  around  longer  than  awareness  of  racism. 

The  majority  of  staff  in  the  non-profit  sector  are  women,  many  of  them  in 
management  positions.  Over  time  they  have,  more  than  likely,  spoken  out 
against  sexist  remarks. 

On  the  other  hand,  there  are  very  few  visible  minorities  working  in  these 
agencies.  The  small  numbers  hold  very  little  organizational  power  to  challenge 
and  combat  racist  comments. 


This  suggests  that  finally  there  is  “an  across  the  board”  discomfort  with  “racist  remarks” 
and  slurs.  In  time,  this  could  translate  into  a much  needed  support  structure  for  ethnic/racial 
minority  staff  and  board.  One  of  the  evaluators  who  herself  belongs  to  an  ethnic  minority 
group  reflects  that  there  is  a world  of  difference  between  how  minorities  feel  about  racist 
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remarks  compared  to  “mainstream”  white  people  in  Canada  Racist  remarks  undermine  the 
confidence  of  an  ethnic  minority  Canadian  much  more  than  they  would  affect  members  of  the 
ethnic  majority  in  Canada.  Perhaps,  says  the  other  evaluator  (a  “mainsteam”  white  male),  this  is 
a measure  of  how  much  further  we  still  need  to  go  as  a society  - until  slurs  against  visible  and 
other  minorities  are  perceived  by  white,  mainstream  Canadians  as  a personal  issue  to  be 
addressed,  and  as  creating  a negative,  unsafe  environment  generally,  multiculturalism  & 
diversity  will  still  be  operating  on  the  “charity”  model  with  “special”  beneficiaries,  and  not,  as  it 
should  be,  for  the  benefit  of  all  as  a Public  Good. 

Anecdotal  comments  support  the  contention  that  the  MOC  project  has  helped  in  creating 
a safe  environment  for  the  staff  and  board  to  air  these  sensitive  diversity  issues 
(Table  3B,  Section  2. 3.2.4).  It  can  be  asserted  that,  awareness  without  a corresponding  safe 
environment  will  likely  be  short  lived  and  will  be  construed  as  unethical.  One  of  the 
stakeholders  asserts: 

"...thinking  about  the  whole  process  y of  how  we  expect  each  other  to  speak  openly  about 
things  that  put  us  at  risk,  possibly. . . How  do  we  create  a process  by  which  we  are  able 
to  talk  about  our  response  to  change,  the  negatives  as  well  as  positives?  Things  like 
how  does  a manager  act  in  a vulnerable  way  and  acknowledge  that  they  don't  have  all 
the  answers?  And,  how  does  a person  with  less  power  say  they  are  not  happy  with  the 
way  things  are  going  here;  Its  not  working  for  me?  How  do  we  create  an  environment 
where  those  kinds  of  discussions  can  be  had  in  an  honest  way?.  If  you  take  me  half  the 
journey,  you're  telling  me  I can  speak,  have  a voice,  and  I'm  going  to  start  taking  risks 
- and  there  is  nobody  there  to  catch  me  when  I fall  - then  I would  judge  this  as 
unethical,  in  my  opinion.  ” 

Lastly,  only  the  VM  sub-group  perceived  that  co-workers  need  to  understand  how 
minority  groups  feel.  They  have  also  seen  an  increase  in  conflict  when  diversity  issues  are 
raised  in  their  organization  between  1993  and  1996. 


2.3.3.5.2  Construct  2.  Management  Dedication  to  Organizational  Openness. 

The  stakeholders  concentrated  on  resolving  the  following  questions  raised  by  the 
evaluation: 

■ Why  was  the  VM  the  only  sub-group  (out  of  the  seven  sub-groups)  that  did  not 
report  changes  in  Management  Dedication  to  Organizational  Openness  between 
1993  and  1996? 


The  term  “mainstream”  is  used  here  to  refer  to  Ihe  main  predominant  culture  & race  of  Canada, 
also  kno>\m  as  the  “ethnic  majority.”  This  group  is  distinct  from  the  sub-group  NVM  in  this  evaluation. 
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Why  did  the  non-manager  sub-group  report  that  in  1996  senior  managers  and 
policy  makers  were  less  committed  to  change  than  they  were  in  1993? 


The  available  data  clearly  suggests  that  the  VM  sub-group  received  a differential  impact 
(in  fact  they  did  not  change  their  views)  concerning  issues/activities  related  to  Management 
Dedication  to  Organizational  Openness  compared  to  the  other  six  sub-groups.  In  1993  all  the 
seven  groups  (including  the  VM  sub-group)  had  similar  mean  scores  for  the  nine  items  which 
define  the  above  construct.  In  the  impact  assessment  (1996),  this  sub-group  did  not 
significantly  change  their  views  about  management  dedication  to  openness;  whereas,  the  other 
six  sub-groups  (5  staff  and  board)  reported  a significant  increase  in  Management  Dedication  to 
Organizational  Openness  since  the  baseline  assessment. 

Four  possible  explanations  are  forwarded  to  explain  the  above  finding: 

1)  The  VM  sub-group  feel  hardened  or  immune  to  processes  such  as  the  MOC,  because  in 
their  experience  they  do  not  really  change  their  lives.  One  of  the  stakeholders  put  it: 

'"Within  [other]  subgroups,  it's  the  sense  that  have  they  seen  enough  to  be  able  to 
feel  comfortable  that  the  organization  is  definitely  moving  ahead.  So  the  visible 
minority  group,  ...in  their  understanding  of  the  process,  are  saying,  "you  haven't 
even  really  moved  - [between  1993  and  1996].  It  was  good  that  you  had  a 
visible  role  in  doing  this  but  we  haven't  seen  anything  different  for  us  to  feel: 

Wow,  you've  taken  it  further  to  the  degree  that  visible  minorities  would  have  felt 
comfortable. '” 

Another  stakeholder  suggested: 

“But  for  someone  who's  at  the  receiving  end  of  [discriminatory]  behaviour  it  is  perhaps 
[only]  a small  change.  “ 

2)  VM  respondents,  were  less  enthusiastic  or  even  skeptical  about  the  change  process  to  begin 
with,  and  therefore  less  supportive  of  what  has  happened.  There  is  no  data  to  support  or  refute 
this  contention. 

3)  It  is  probable  that  each  sub-group  entered  this  process  with  varying  expectations  based  upon 
their  unique  personal  experiences.  Perhaps  this  sub-group’s  expectations  were  not  entirely  met. 
The  evaluators  agree  with  one  of  the  stakeholder’s  beliefs  that  projects  such  as  the  MOC  will  be 
construed  ineffective  if  they  fail  to  change  personal  experiences.  In  the  stakeholder’s  words: 

“But ...  if  [visible  minority's]  experience  hasn't  changed  from  day  to  day  in  spite  of  the 
work  that  has  been  done  [MOC  will  not  be  construed  as  an  effective  change  agent]  .... 
If  that  [particular]  experience  hasn't  changed  [then  the  change  has  not  occurred].  ” 
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4)  Based  on  previous  experiences,  the  VM  respondents,  probably  predict  that  the  MOC 
process  and  its  impact  was  destined  to  be  short  lived.  A stakeholder  articulates  this  point  as 
follows: 


7 wonder  if,.,  its  a short  term  thing,  . . . flavour  of  the  month,  so,  how  far  are  we 
going  to  get,  so,  let's  just  see  where  it  takes  us  before  I start  getting  really  optimistic 
about  real  change.  ” 

This  point  seems  to  carry  an  implicit  “message”  that  the  mainstream  staff  (in  this  study 
sub-group  NVM  may  be  viewed  as  a proxy  sub-group  for  “mainstream”  in  Canada)  may  be  less 
likely  to  challenge  organizational  management  compared  to  the  visible  minority  sub-group  on 
the  subject  of  diversity  issues. 

By  and  large,  non-managers  perceived  an  increase  in  management  dedication  to 
openness  between  1993  and  1996:  The  1996  non-managers  agreed  significantly  more  strongly 
with  four  items  dealing  with  the  “overall  plan  for  openness”,  “open  forum  to  discuss  diversity 
issues”,  “training  for  the  staff  around  diversity  issues”  and  “quality  of  service”.  But,  non- 
managers perceived  a statistically  significant  decrease  in  the  level  of  “commitment  at  the  top  of 
the  organization”  between  1993  and  1996.  How  can  one  explain  this?  Is  this  difference 
between  managers  and  non-managers  a healthy  or  unhealthy  phenomenon  in  the  workings  of  an 
organization?  Did  resources  and  leadership  required  to  sustain  diversity  initiatives  wane  by 
1996?  Do  non-managers  and  managers  have  (or  have  to  have)  a different  foci  based  on  their 
respective  job  descriptions  and  responsibilities?  Do  managers  have  their  hands  full  in 
addressing  the  other  organizational  issues  - less  funding,  etc.^  ? 

2.3.3.5.3  Construct  3:  Bringing  Down  Barriers  to  Hiring/Promoting. 

Between  1993  and  1996,  all  of  the  seven  sub-groups  have  increased  their  commitment  to 
bringing  down  barriers  to  hiring  and  further  promotion.  In  1996  males,  non-managers,  VM, 
NVM  and  board  sub-groups  agreed  less  strongly  with  the  items:  “I  will  have  difficulty  being 
supervised  by  someone  from  an  ethnic  group  different  from  my  own”;  “I  will  have  difficulty 
being  supervised  by  someone  from  the  opposite  sex”.  Females  and  non-managers  agreed  less 
strongly  with  the  item:  “I  will  have  difficulty  working  with  someone  whose  sexual  orientation  is 
different  than  my  own”.  Even  at  the  base-line  (1993)  assessment,  all  of  the  seven  sub-groups 


The  evaluators  got  this  clear  message  when  diey  presented  agency  specific  data  to  14 
participating  agencies  during  the  Summer  of  1996. 
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either  disagreed  or  strongly  disagreed  with  the  three  items  measuring  the  elements  of  the  above 
construct:  “I  will  have  difficulty  being  supervised  by  someone  from  an  ethnic  group  different 
from  my  own”  (mean  range=  1.28  to  1.73);  “I  wiU  have  difficulty  being  supervised  by 
someone  from  the  opposite  sex”  (mean  range  =1.48  to  1.62);  “I  wiU  have  difficulty  working 
with  someone  whose  sexual  orientation  is  different  from  my  own”  (mean  range=1.64  to  1.77). 
(See  Table  7D,  Section  2.3.2. 8.) 

Note,  even  in  1996,  there  was  evidence  of  discomfort  (“agreed”  with  the  test  items)  in 
working  with  and  or  being  supervised  by  people  with  different  diversity  attributes:  2%  of  the 
staff  reported  having  “difficulty  being  supervised  by  someone  from  the  opposite  sex”,  and  2% 
of  the  staff  reported  having  “difficulty  working  with  someone  of  different  sexual  orientation”. 

Is  it  perhaps  impossible  to  completely  eliminate  prejudice  or  preconceived  notions  from  the 
organization?  It  is  essential  to  also  point  out  that  people  who  conduct  attitudinal  surveys  (such 
as  the  one  under  discussion),  regularly  recognize  that  respondents  typically  understate  (e.g.,  a 
score  of  “disagreement”  may  translate  to  “neither  agreement  nor  disagreement”)  their  views 
which  are  likely  to  be  considered  non-professional,  petty  and  judgemental.  The  implicit 
message  here  is  that  there  may  be  more  discomfort  related  to  diversity  than  picked  up  by  the 
workforce  survey. 

2.3.3.5.4  Construct  4;  Personal  Dedication  to  Organizational  Openness. 

Surprisingly,  none  of  the  sub-groups  saw  a change  in  their  personal  dedication  to 
openness.  There  were  no  statistically  significant  change  in  scores  between  1993  and  1996  in 
the  responses  to  three  items.  Perhaps  there  was  nothing  that  respondents  felt  needed  to  change! 
Note  that  in  1993  the  mean  values  for  the  three  items  measuring  the  construct  are:  “How  high  a 
priority  do  you  place  on  increasing  organizational  openness”?  (mean  range  93=3.73  to  3.82); 
“Opening  up  the  organization  will  make  my  job  more  secure”  (mean  range  93=  3.08  to  3.51); 
“I  am  too  busy  doing  my  regular  work  to  deal  with  the  openness  issues”  (mean  range  93  = 1.79 
to  2.28)  (Table  7E,  2.3.2.8). 

The  above  evidence  can  be  explained  by  either  or  both  of  following  arguments:  a)  both 
the  staff  and  the  board  do  not  fully  imderstand  and  cannot  envision  their  roles  and 
responsibilities  in  the  “hypothetical”  fuUy  open  organization;  or  b)  notwithstanding  the  above, 
diversity  is  only  one  among  several  different  organizational  issues.  While  the  latter 
explanation  probably  depicts  the  state  of  affairs  accurately,  the  former  also  has  elements  of 
truth.  The  question  is  “how  high  a personal  priority”  is  required  to  take  action  on  respecting 
and  accepting  organizational  diversity?”  This  is  at  best  a question  of  judgement. 
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2.3.3.6  MOC\S  Impacts  On  Specific  Organizational  Relationships 
Impact  Question  6 


What  is  the  change  in  the  relationship  between  selected  pairs  of  sub-groups  in 
dealing  with  diversity  issues  between  1993  and  1996  (e.g.  is  there  a change  in  how 
males  and  females  or  managers/non-managers  relate  to  each  other  in  1996 
compared  to  1993)? 


It  is  reasonable  to  hypothesize  that:  In  the  wake  of  MOC  some  organizational 
relationships  have  changed.  For  instance,  do  males  and  females  relate  to  each  other 
differently  after  the  formal  conclusion  of  MOC?  The  data  were  analyzed  to  determine 
changes  in  relationship  between  following  four  dyads. 

■ VM/NVM; 

■ Managers/Non-managers; 

■ Males/Females;  and 

■ Board/Staff 

Tables  8 A to  8D  (Section  2. 3. 2. 9)  outline  changes  in  the  above  relationships  between 
1993  and  1996. 

2.3.3.6.1  The  VM/NVM  dvad. 

It  appears  MOC  may  have  helped  in  creating  a supportive  environment  for  visible 
minorities  (represented  by  the  VM  sub-group  in  this  study)  to  empower  themselves.  A series 
of  changes  presented  in  Tables  8A  to  8D  suggest  that  visible  minority  staff  may  have 
acquired  increased  confidence  and  the  ability  to  express  themselves  between  1993  and  1996. 
In  1996,  the  VM  sub-group  (compared  to  the  NVM  sub-group)  were  more  free  to  speak  up 
on  sensitive  issues,  to  point  out  deficiencies  in  their  management's  dedication  to 
organizational  openness  and  also  placed  a higher  “personal  priority  to  openness”.  This  is 
particularly  supported  by  the  finding  that  in  1996  this  sub-group  agreed  more  strongly  with 
the  four  items  measuring  Freedom  to  Speak  up  on  Sensitive  Issues  (“people  not  treated  fairly 
because  they  appear  different”,  “my  co-workers  need  to  be  more  understanding  of  how 
people  in  minority  groups  feel”,  “there  is  conflict  when  diversity  issues  are  raised  in  our 
organization”  and  “there  is  confusion  about  how  to  communicate  with  people  who  are 
different”). 


MOC’s  Description  & Impacts  Page  140 


♦qirtzDortttbt  m 


-^rm.  A .WiimmXi  xjwiX^raaTjcr 


^>-Arf  'mti  y^^■octIm  (3!S.;®“AI'»Si(#!1'^|j4'|^^  “ 

u?*  ittys.j,  m ^i\rtit.>OT  i't!^W^i;»juma-apa  oi  '&t  Jbi^l  ol. 

CA  lU')Viin’tUVA 
SI  iufT  /•«>/ai5.p  Qj  x^nortq 

vtioom  rftm  tmm 

{hMi  baisafi)  70(\  ^uVuvali'Irtt:^^  oi 

-jvwp  A o?  ^t^sh 

i||(s  iii  jtB  r.-j'iw  ? ; xiAr 

;x?w  siacM  i Ll:^‘^nutw!nfrt  ^ MraiJ  ukxIm  odl4;^(foa  <f  ^ix»E  "rif*^' 


speaking  of  Management  Dedication  to  Organizational  Openness,  in  1996  the  VM 
sub-group  (compared  to  NVM  sub-group)  reported  a higher  agreement  with  the  item,  “their 
agency  thinks  only  of  mainstream  consumers  while  advertising  for  their  programs  and 
services”  and  was  less  likely  to  agree  with  the  item,  “staff  are  motivated  to  work  together”. 

Lastly,  in  1996  the  VM  sub-group  compared  to  the  NVM  sub-group  placed  a higher 
“personal  priority  on  increasing  organizational  openness”.  This  difference  in  perception  was 
not  evident  in  the  base-line  survey  (1993)  (See  Table  8B).  While  these  changes  are  clearly 
good  for  the  visible  minorities  personally  and  for  the  organization  as  well,  they  do  pose  a 
risk  or  a threat  to  the  visible  minority  staff,  whether  self  identified  or  not.  To  express  one’s 
view  is  only  a small  part  of  the  diversity  equation.  Without  a genuine  ongoing  commitment 
by  the  management  and  boards  of  Calgary’s  human  service  organizations  to  address  equity 
issues,  the  changes  that  have  been  accomplished  between  1993  and  1996  can  fade  away  or 
even  result  in  a backlash  and  discrimination. 

2.3.3.6.2  The  Managers/Non-managers  dvad. 

Tables  8 A to  8D  indicate  that  in  1996  managers  and  non-managers  expressed  shared 
and  common  perceptions  respecting  Management  Dedication  to  Organizational  Openness  and 
Freedom  to  Speak  up  on  Sensitive  Issues.  Managers  and  non-managers  have  more  in 
common  in  1996  than  they  had  in  1993  concerning  some  crucial  diversity  issues.  For 
instance,  in  1993  non-managers  agreed  more  strongly  with  four  perceived  Management 
Dedication  to  Organizational  Openness  related  items  such  as,  “there  is  commitment  at  the 
top  of  the  organization”.  In  1996  this  differences  disappeared.  This  could  be  attributable  to 
non-managers  being  more  enthusiastic  than  their  managers  about  their  organization’s 
participation  in  MOC  in  1993.  Three  years  later  and  further  along  the  learning  curve  for 
MOC,  other  organizational  issues  may  have  become  more  prominent. 

On  the  subject  of  Freedom  to  Speak  up  on  Sensitive  Issues,  in  1993  managers  agreed 
more  strongly  than  non-managers  with  items  such  as,  “I  hear  racist  remarks  in  my 
organization”  and  “I  hear  sexist  remarks  in  my  organization”.  Despite  an  increase  in 
agreement  with  these  items  by  both  members  in  the  dyad,  there  was  no  statistical  difference 
in  their  responses  in  1996.  This  may  be  a result  of  non-managers  “catching  up”  with  their 
management  in  awareness  of  racism  and  sexism. 

2.3.3.6.3  The  Females/lMales  dvad. 

In  1996,  females  (compared  to  1996  males  as  well  as  1993  females)  were  significantly 
less  inclined  to  work  with  male  supervisors  and  bosses.  This  seems  to  have  been  an 
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unintended  outcome  of  the  MOC  project,  possibly  as  a result  of  greater  awareness  of 
exclusion  issues,  including  sexism.  This  may  be  an  indicator  that  the  women  in  this  study 
see  the  men  they  work  with  as  limiting  their  creative  and  intellectual  development,  and  have 
a strong  desire  to  break  out  of  stereotypical  female  job  roles.  There  is  sympathetic  evidence 
on  this  issue.  Findings  revealed  that  in  both  1993  and  1996  a much  lower  proportion  of 
female  staff  (21%)  were  in  management  positions  compared  to  male  staff  (35%).  Also  note, 
these  statistics  did  not  change  between  1993  and  1996. 

2.3.3.6.4  The  Staff/Board  dvad. 

This  dyad  changed  in  two  fundamental  items/issues:  “my  organization  provides 
quality  services  to  people  of  different  backgrounds”  and  people  are  not  treated  fairly  because 
they  appear  different.  These  two  items  relate  respectively  to  the  constructs.  Management 
Dedication  to  Organizational  Openness  and  Freedom  to  Speak  up  on  Sensitive  Issues. 

In  1996  the  board  agreed  more  strongly  than  the  staff  with  the  item  “my  organization 
provides  quality  services  to  people  of  different  backgrounds”.  In  1993  there  was  no 
significant  difference  in  perception  on  this  issue.  This  finding  suggests  that  there  was  a 
perception  gap  between  1993  and  1996  in  this  context.  On  another  critical  issue  the 
perception  gap  closed.  In  1996  the  staff  and  board  perceived  similarly  (scored  similarly)  on 
the  item,  “people  are  not  treated  fairly  because  they  appear  different”.  In  1993  the  staff 
agreed  significantly  higher  than  the  board. 

2.3.3.7  Overall  Attitudinal  Changes  in  the  Participating  Agencies 

Impact  Question  7 

How  have  the  fourteen  agencies  changed  between  1993  and  1996? 


While  answers  to  impact  questions  5 and  6 help  describe  changes  in  sub-groups  as 
well  as  selected  dyads,  they  fail  to  provide  any  information  about  the  type  of  changes  which 
took  place  within  individual  agencies.  The  evaluators  asked:  What  changes  (if  any) 
manifested  in  the  agency  “A”  between  1993  and  1996  25.  Only  nine  out  of  the  15  agencies 


Evaluators  are  not  free  to  divulge  agency  names  and  characteristics.  Information  about 
agency-specific  changes  was  provided  to  the  14  agencies  individually. 
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had  staff  sample  sizes  adequate  enough  to  conduct  such  an  analysis  ^6. 

The  following  paragraphs  briefly  describe  changes  as  reported  by  staff  of  nine 
agencies,  in  Management  Dedication  to  Organizational  Openness,  Freedom  to  Speak  up  on 
Sensitive  Issues,  Bringing  Down  Barriers  to  Hiring/ Promoting  and  Personal  Dedication  to 
Organizational  Openness  within  the  nine  agencies.  The  board  responses  were  excluded  in 
this  analysis. 

2.3.3.7.1  Construct  1.  Freedom  to  Speak  up  on  Sensitive  Issues, 

To  measure  agency-specific  changes  related  to  this  construct  the  evaluators  focused  on 
only  three  (out  of  seven)  items/questions  dealing  with:  “the  incidence  of  racist  remarks”, 
“incidence  of  sexist  remarks”  and  “treatment  of  staff  based  upon  their  appearances”. 

Agency-specific  data  revealed  that  staff  of  five  agencies  did  not  witness  any 
significant  changes  (neither  increase  nor  decrease)  in  frequency  of  “racist  remarks”,  “sexist 
remarks”  as  well  “as  treatment  of  their  colleagues  based  on  their  appearances”  between  1993 
and  1996.  Another  two  agencies  reported  an  increase  in  “noticing”  that  their  colleagues  are 
treated  (unfairly)  differently  based  on  their  appearances  (e.g.,  colour,  disability)  between 
1993  and  1996.  One  out  of  the  remaining  two  agencies’  data  revealed  that  their  staff  have 
“noticed”  a significant  increase  in  all  of  the  three  events  between  1993  and  1996.  Lastly,  the 
staff  of  the  remaining  agency  report  an  increased  incidence  of  “racist  and  sexist  remarks”  in 
their  organization. 

2.3. 3. 7.2  Construct  2.  Manaeement  Dedication  to  Organizational  Openness. 

To  measure  agency-specific  changes  related  to  this  construct  the  evaluators  focused  on 
only  three  (out  of  nine)  items/question  dealing  with:  “level  of  management  priority  to 
openness”,  commitment  to  change  at  the  top  of  the  organization  and  “training  for  the  staff”. 

Staff  of  three  agencies  reported  that  there  were  no  significant  changes  in  Management 
Dedication  to  Organizational  Openness  in  their  respective  agencies,  i.e.,  mean  scores  of  the 
three  items  remained  virtually  the  same  between  1993  and  1996.  Another  four  agencies 
reported  a significant  increase  in  “staff  training”  between  1993  and  1996.  One  of  these  four 
agencies  also  reported  an  “increase  in  management  priority  to  openness”  between  1993  and 
1996.  Interestingly,  the  remaining  two  agencies  reported  a significant  decrease  in 
“commitment  to  diversity  at  the  top”  and  the  “management  priority  to  organizational 


Although  fourteen  agencies  participated  in  the  1996  survey,  one  agency  had  one  sub- 
agency or  a tributary.  For  this  analysis  the  sub-agency  has  been  treated  as  a separate  entity. 
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2.3.3.7.3  Construct  3.  Brinan^  Down  Barriers  to  Hiring/Promoting. 

To  measure  agency-specific  changes  related  to  this  construct  the  evduators  focused  on 
only  one  (out  of  three)  items/questions  dealing  with:  “level  of  difficulty  being  supervised  by 
someone  from  a different  ethnic  background”. 

In  1996  the  staff  of  three  agencies  confirmed  their  original  beliefs  (revealed  in  the 
1993  survey)  that  they  would  not  have  difficulty  having  a “supervisor  with  a different  ethnic 
background  from  their  own”.  The  rest  (six  agencies)  did  not  change  their  scores  (therefore 
their  position)  about  this  item  between  1993  and  1996.  Their  position  in  the  baseline 
assessment  was  that  they  would  not  have  any  “difficulty  having  a supervisor  from  a different 
ethnic  background”. 

2.3.3.7.4  Constract  4.  Personal  Dedication  to  Organizational  Openness. 

To  measure  agency-specific  changes  related  to  this  construct  the  evaluators  focused  on 
only  one  (out  of  three)  items/questions  dealing  with:  “level  of  personal  priority  to 
openness”. 

Agency-specific  data  revealed  that  none  of  the  nine  agencies’  staff  reported  a 
significant  change  (neither  increase  or  decrease)  in  “level  of  personal  priority  to  openness” 
between  1993  and  1996.  These  nine  agencies  reported  a relatively  high  “level  of  personal 
priority  to  organizational  openness”  in  1993:  range  of  mean  scores^  3.59  to  4.15. 

2.33.8  MOC^S  Impacts  On  Staff  and  Board  Composition 

Impact  Question  8 

Did  the  MOC  project  mfluence  participating  agencies  to  diversify  then- 

staff  and  board  members? 


The  available  information  precludes  any  conclusive  comments  on  this  issue  because  of 
low  return  rates  (less  than  60%  for  staff  and  less  than  30%  for  board).  Nonetheless  a 
comparative  view  between  the  base-line  (1993)  and  the  impact  survey  (1996)  revealed  that 
there  have  been  no  discemable  changes  in  staff  md  board  demographic  composition  between 
1993  and  1996  based  on  respondents’  gender,  level  of  formal  education,  spoken  and/or 
written  languages,  age,  religion,  perceived  visible  minority  status  (sub-group  VM  or  NVM), 
and  length  of  time  in  Canada.  In  1993  it  was  noted  that  the  majority  of  participating 
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agencies’  staff  composition  was  made  up  of  “mainstream”  (white,  Anglo-Saxon,  able-bodied, 
English-speaking)  individuals.  In  aggregate,  both  in  1993  and  in  1996  there  was, 
nonetheless,  some  presence  of  diversity  in  cultures,  languages  and  religions  within  staff  and 
board  cohorts  (Tables  C-1  to  C-7,  Appendix  C).  Due  to  the  sampling  methods  employed, 
the  staff  and  board  demographic  data  (e.g.,  ethnic  backgrounds,  language)  were  not 
compared  to  either  City  of  Calgary  or  Statistics  Canada  census  to  determine  whether  or  not 
agency  staff  and  board  compositions  reflect  the  community  demographics. 

The  apparent  lack  of  change  in  staff  and  board  (especially  board)  composition 
between  1993  and  1996  prompted  some  concern  as  well  as  discussion  in  the  stakeholders 
meeting.  One  stakeholder  surmises  that  organizational  machinery  is  such  that  it 
automatically  shuts  out  some  groups  of  people: 

"...  do  you  actually  want  to  read  these  numbers  and  ask  the  question  about  how  do 
we  hire  the  next  Board  member,  how  do  we  hire  the  next  staff  member.  I think  they 
are  so  stark...  Fve  seen  about  3-4  ads  in  a very  specific  part  of  the  newspaper  about 
who  they  want  in  the  Board  and  I can  tell  you  obviously  that  it  will  automatically 
reject  a lot  of  people  that  are  currently  not  recruited  on  Boards,  so  it  reinforces  that 
message,  that  yes  we  don't  want  you  because  we've  said  it  all  along  and  here  are  the 
numbers  to  prove  it.  " 

2. 3.3.9  MOC^S  Impacts  On  Composition  Of  The  Consumers 
Impact  Question  9 

Did  the  MOC  project  mfluence  participating  agencies  to  diversify  their 
consumers/cHents  (are  more  diverse  clients  accessing  the  services  offered 
by  the  agencies?) 


There  is  some  evidence  of  a change  in  the  consumer  populations.  Board  and  staff 
respondents  reported  that  selected  programs  have  more  diverse  (“somewhat  diverse”  and 
“much  more  diverse”)  consumers  in  1996  compared  to  1993.  The  fourteen  agencies  reported 
that  their  programs  and  services  have  become  anywhere  from  14  to  35%  “more  diverse” 
and/or  “much  more  diverse”,  depending  upon  which  of  the  9 diversity  related  characteristics 
one  is  focussing:  age  distribution  (28%),  gender  ratio  (18%),  income  distribution  (14%)), 
family  makeup  distribution  (14%)),  first  language  distribution  (30%o),  race/ethnicity 
distribution  (35%)),  ability /disability  distribution  (20%)),  sexual  orientation  distribution  (18%o), 
religion/spirituality  distribution  (19%))  (See  Table  9A,  Section  2.3.2.12). 

It  is  of  note  that  among  the  nine  diversity  characteristics,  between  40%  and  60%  of 
staff  were  unable  to  make  an  assessment  of  the  change  in  the  demographics  of  the 
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participation  in  their  programs  during  the  time  period  (Table  9A).  The  following  reasons 
may  explain  this:  staff  turnover;  new  programs;  discomfort  with  giving  an  estimate  based  on 
their  subjective  observation;  except  for  gender  distribution  within  the  programs  and  services, 
the  remaining  eight  characteristics  may  be  considered  personal  and  private  (e.g.,  sexual 
orientation,  religion)  and  the  respondents  could  not  easily  access  this  information. 

A look  at  Table  9B  (Section  2.3.2.12)  indicates  that  consumer  populations  became 
more  diverse  due  to  a combination  of  external  and  internal  factors.  The  single  most  important 
critical  external  factor  in  diversifying  consumer  populations  (i.e.,  diversifying  programs  and 
services)  was  the  change  in  community  demographics.  To  align  themselves  with  the  changes 
in  the  community  demographics  (gender  ratio,  income  composition,  etc.)  these  agencies 
changed  some  internal  factors  - notably  changes  in  attitudes,  philosophy,  outreach/referral 
practices  and  program  changes. 

Some  programs  and  services  may  have  been  historically  tied  to  a specific  target  group 
like  teenage  mothers  or  recipients  of  unemployment  benefits,  which  may  explain  some  of  the 
reported  lack  of  change.  For  instance,  clients  of  a ‘hypothetical  program’  for  teenage 
mothers  might  have  changed  in  composition  concerning  ethnic  backgrounds  and  income 
levels  but  obviously  not  concerning  gender  and  age.  The  available  data  does  not  allow  the 
evaluators  to  determine  whether  or  not  the  program  is  accessible  to  all  teenage  mothers 
irrespective  of  other  factors  (e.g.,  ethnicity,  income,  education  or  life  style).  One  can  build 
such  a case  for  virtually  any  program  which  is  reported  to  be  tied  down  conceptually  and 
historically  to  a target  group.  Also,  some  programs  and  services  were  already  attracting  a 
diverse  set  of  clients/consumers. 

Lastly,  a very  small  percentage  of  programs  and  services  actually  became  less  diverse 
in  the  course  of  the  study  period.  One  reason  why  programs  may  have  been  less  diverse  in 
1996  compared  to  1993  is  due  to  the  socio-economic  forces  at  play  in  the  community. 
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3.0  Implications/Future  Directions  for  MOC 

The  stakeholders  pondered  on  the  future  of  the  MOC  process  in  light  of  the  following 
options: 

1.  Should  the  MOC  process  continue  without  modification? 

2.  Should  the  MOC  process  continue  with  modiHcation? 

3.  Should  the  MOC  process  be  discontinued? 

Based  on  the  findings  of  the  evaluation  as  well  as  their  own  personal  experiences  the 
stakeholders  selected  option  Number  2.  Almost  unanimously,  participants  at  the  stakeholder 
meeting  wanted  diversity  work  to  continue  to  evolve  and  improve  so  that  it  becomes  fully 
integrated  into  the  work  of  every  organization. 

At  the  three-year  mark,  the  organizational  change  process  has  affected  the  workings 
of  the  organizations  most  prominently,  but  has  also  had  a secondary,  or  “ripple”,  effects  on 
personal  being  (e.g.,  personal  awareness)  on  the  staff  and  board,  and  lastly  on  the 
composition  of  consumers.  By  and  large,  but  not  exclusively,  the  primary  and  the 
secondary  impacts  were  positive  in  nature.  There  were  some  negative  impacts  from  the  MOC 
process,  but  the  positives  overwhelmingly  outweighed  the  negatives,  prompting  stakeholders 
to  search  for  ways  to  solidify  the  gains  made  by  this  process,  and  continue  MOC  in  some 
form. 

The  MOC  initiative  has  shown  that  local  context  and  dynamics  are  so  critical  that, 
beyond  a few  critical  factors,  no  single  or  “canned”  approach  will  work  in  all  organizations. 
What  the  organization  thinks  of  as  the  task  of  “accessibility”  and  how  these  questions  are 
asked  and  answered,  determine  the  actions  that  follow.  Is  change  a top-down  or  bottom-up 
process,  or  are  both  required?  Can  organizational  change  be  mandated,  or  should  it  be 
voluntary?  Can  people  be  “made”  to  change?  Do  the  personal  experiences  of  organizational 
leaders  lead  to  attitudinal  changes,  which  then  creates  the  environment  which  helps  the 
organization  to  change?  Should  the  change  effort  focus  on  attitudes,  behaviors,  or  on  skills? 
The  key  to  answering  these  questions,  in  a way  which  makes  sense  for  the  organization,  is 
the  development  and  collection  of  actual  data  through  an  organizational  assessment  and 
subsequent  evaluation. 

3.1  Rationale  for  Retaining  MOC 

In  the  absence  of  a pre-determined/prescriptive  set  of  criteria  or  ‘benchmarks’  the 
findings  could  be  interpreted  in  so  many  different  ways.  Although  board  and  staff  responses 
guided  the  evaluators  about  what  is  ‘good’  and  ‘bad’  in  the  MOC  process  and  outcomes,  at 
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times  it  was  difficult  to  determine  whether  a particular  impact  was  received  positively  or 
negatively  by  all.  What  is  positive  for  some  may  be  “no  effect”  or  even  negative  for  others. 

Despite  the  glitches,  problems  and  differential  impacts,  MOC  left  an  important  overall 
message  that  diversity  has  a critical  but  just  recognized  role  to  play  in  Calgary’s  human 
services  sector.  Human  service  organizations  at  least  recognize  that  a significant  part  of  the 
question  about  whether  MOC  was  successful  has  to  do  with  the  understanding  of  change  that 
different  individuals,  groups  and  organizations  hold.  Organizations  which  typically  started 
out  thinking  the  problem  was  one  of  advertising  and  that  translating  their  communications 
into  other  languages  would  suffice,  have  begun  to  recognize  the  long-term  nature  of  the 
problems  of  accessibility  for  all.  The  MOC  initiative  clearly  revealed  that  tinkering  with 
“external  optics”  rarely  has  any  more  than  a superficial  effect  because  the  problem  of 
culturally  inappropriate  services  is  much  more  complex. 

MOC  also  attempted  to  address  diversity  issues  as  a workforce  issue,  not  only  as  an 
issue  for  people  outside  the  organization  wanting  appropriate  services.  In  fact,  we  have 
some  evidence  that  the  organizations  with  the  most  success  in  implementing  MOC  made  clear 
the  linkages  between  addressing  accessibility  and  openness  issues  internally  with  their  own 
staff  at  the  same  time  as  they  addressed  diversity  externally.  These  internal  diversity  issues 
have  the  effect  of  sabotaging  anything  the  organization  may  try  externally  and  typically 
manifest  themselves  as  “management  problems”. 

The  stakeholders  discussed  the  following  elements  with  the  view  to  making  MOC’s 
process  and  impacts  even  more  positive  and  inclusive:  goals/philosophy,  training,  policies 
for  the  individual  agencies  and  evaluation  of  MOC. 

3.2  MOC’s  Philosophy/Goals/Objectives 

None  of  the  concerns  were  about  the  objectives  and  goals  of  MOC:  no  one  disputed 
the  need  for  equitable,  inclusive  services  and  an  equitable  workplace.  Criticism  did  centre 
on  the  methodology  and  the  philosophical  approach  that  was  employed  in  the  MOC  training 
intervention  for  addressing  diversity  and  exclusion  issues.  Some  comments  reflected  a 
concern  that  MOC,  contrary  to  its  stated  aim  of  valuing  all  diversity,  did  not  equally  respect 
and  value  the  concerns,  values  and  experience  of  everyone  in  the  agency.  Comments  about 
“reverse  discrimination”  clearly  suggest  some  ‘mainstream’  staff  and  board  felt  that 
supporting  MOC  would  put  their  “Canadian”  identity  and  privileges  at  risk.  Some  viewed 
the  intervention  negatively  because  MOC  attempted  to  foster  a change  in  the  workplace 
relationships  - a domain  previously  considered  out  of  the  bounds  of  external  intervention. 

The  member  agencies  were  concerned  about  their  autonomy  because  their  funder,  the  United 
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Way,  was  at  the  root  of  affecting  these  changes.  Lastly,  there  were  concerns  about  the  time, 
energy  and  resources  that  MOC  required.  The  advent  of  the  Diversity  Learning  Institute 
(DLI)  might  have  already  mitigated  some  negative  feelings  because  The  United  Way  of 
Calgary  and  area  is  no  longer  leading  the  MOC  process. 

3.3  MOC’s  Training 

The  evaluators  did  not  collect  first-hand  or  primary  data  to  determine  the  effectiveness 
of  the  training  team  or  how  the  front  line  trainers  were  selected  for  the  job.  It  was  assumed 
that  trainers  were  selected  on  the  bases  of  the  following  skills  and  knowledge  which: 

a.  reflect  an  analysis  of  power,  privilege  and  oppression,  at  a personal  level  and 
as  it  relates  to  approaches  to  learning. 

b.  demonstrate  self  awareness.  Trainers  who  have  not  dealt  with  the 
impact  of  racism  and  discrimination  in  their  own  lives  may  not  be 
qualified  to  be  trainers  in  this  area. 

To  establish  criteria  for  selecting  trainers  and  then  adhering  to  them  is  paramount  for 
the  success  of  the  MOC  project.  This  point  has  been  raised  here  for  the  sake  of 
completeness.  The  evaluators  are  well  aware  of  the  fact  that  these  principles  were  discussed 
in-depth  during  the  inception  and  planning  phases  of  the  MOC  project. 

3.4  Policy  Initiatives 

The  findings  of  the  evaluation  indicate  that  along  with  support  from  key 
organizational  leaders,  effective  training  teams,  a solid  understanding  of  the  organization’s 
structures,  processes,  culture  and  individual  skills,  the  organization  does  need  to  establish  a 
clear  policy  framework  for  addressing  and  valuing  diversity.  These  policies  have  the  effect 
of  clearly  articulating,  both  internally  and  for  the  external  community,  how  the  organization 
has  internalized  its  responsibilities  and  welcomes  and  addresses  diversity  as  an  ongoing  part 
of  its  day  to  day  processes. 

Allowing  racist  or  sexist  action  to  continue  within  organizations  creates  problems  for 
everyone  in  an  organization,  not  just  those  with  minority  status  (perceived  or  otherwise). 
MOC  clearly  has  helped  build  an  awareness  of  inequity  and  diversity  issues  while  helping 
support  learning  by  all.  Ultimately,  the  organization’s  culture  should  be  able  to  immediately 
address  such  incidents  and  prevent  their  occurrence. 
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3.5  MOC’s  Evaluation 

Intervention  and  training  designed  to  affect  organizational  behaviours  (which  would 
lead  to  changes  in  society),  attitudes  and  values  should  undoubtedly  be  evaluated  rigorously 
and  regularly.  The  current  evaluation  was  fraught  with  limited  resources  and  did  not  have 
the  luxury  to  use  valid  and  reliable  instruments,  i.e.,  to  date,  no  evaluators/researchers  have 
developed  an  exhaustive  or  even  a comprehensive  instrument  to  gauge  organizational 
diversity  and  its  issues.  There  are  few  guidelines  for  future  evaluators  and  students  of 
diversity: 


3.5.1  Steps  taken  to  procure  generalizable  results. 

■ Conduct  a pilot  test  on  5 % of  the  random  sample  drawn.  This  will  allow  the 
evaluators  to  estimate  (crude  estimate)  the  variances  of  key  variables  (e.g., 
gender,  ethnicity).  This  in  turn  will  allow  the  evaluators  to  calculate  the  size 
of  the  representative  sample. 

■ Draw  stratified  random  samples  to  capture  the  heterogeneity  of  the  universe  or 
the  sampling  frame  accurately. 

■ Ensure  high  return  rates  (i.e.,  approximately  75%). 

■ Generate  short,  reliable  and  valid  instrument(s). 

■ Develop  more  qualitative  approaches,  such  ‘as  naturalistic  evaluation’  to 
capture  the  essence  of  diversity  intervention  27  . 

In  this  evaluation  there  was  some  attempt  to  draw  random  samples  of  staff  and  board 
of  each  agency.  But  overall  we  received  only  a 54%  return  rate.  Thus,  the  results  can  not 
be  generalized  to  those  staff  and  volunteers  (including  board)  who  were  included  in  the 
sampling  frame  but  declined  to  participate.  However,  the  results  of  the  study  can  be 
extrapolated  to  other  similar  populations  with  the  same  or  similar  evaluation  questions. 

Lastly,  exploratory  factor  analysis  revealed  four  factors  or  constructs  (see  Section 
2. 3. 2. 3)  which  explains  only  54%  of  the  total  variance  of  responses  to  22  attitudinal  items. 
This  suggests  that  the  1996  (also  1993)  instrument  was  not  exhaustive  (i.e.,  there  are  more 


approach  that  minimizes... technical  jargon,  prior  technical  knowledge,  statistical 
inference,  the  separation  of  the  observer  from  the  subject,  tiie  commitment  to  a single  perspective, 
theoretical  structures,  experimental  design,  propositional  knowledge  --  sometimes  causes.  Instead 
there  is  a focus  on  the  use  of  metaphor,  analogy,  informal  (but  valid)  inference,  vividness  of 
description,  reasons-explanations,  interactiveness,  meanings,  multiple  (legitimate)  perspectives  [and] 
tacit  knowledge.  ” Scriven,  M.  (1991).  Evaluation  Thesaurus  (fourth  edition).  Sage  Publication, 
Newbury  Park,  p.  240. 
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diversity  related  items  “out  there”  which  were  not  included  in  the  workforce  survey). 


3.5.2  Steps  taken  to  generate  valid  and  reliable  instruments. 

Generate  short  instrument(s). 

Develop  more  holistic  and  sensitive  instrument(s).  While  the  four  constructs 
(revealed  through  factor  analysis)  establish  an  important  framework  to  study 
organizational  openness,  there  is  still  a need  to  search  for  more  items/tests  to 
measure  diversity  accurately. 

Develop  success  indicators  which  measure  cross-cultural  successes  of  the 
intervention  rather  than  focussing  on  a success  perceived  by  certain  sub- 
groups and  not  others.  The  Stanford-Binet  IQ.  test  generate  in  the  early  20th 
century  is  a prime  example  of  this  kind  of  flaw  in  die  test  instrument.  TTie  test 
itself  was  skewed  towards  a white,  middle-class  population. 

Instruments  must  appeal  to  already  existent  and  current  organizational 
theories,  models  and  benchmarks  concerning  diversity. 

Questions/items  in  the  instrument(s)  should  be  formulated  in  such  a way,  or 
expressed  in  the  context,  so  that  the  range  of  acceptable  answers  is  smaller 
than  the  range  of  all  the  potential  statements  the  respondent  is  able  to  make,  in 
order  to  limit  the  margin  of  error. 


There  are  some  leading  items  in  the  workforce  survey.  The  item  “I  will  have 
difficulty  being  supervised  by  someone  whose  ethnic  background  is  different  than  my  own”, 
is  significant.  This  item  gives  the  a priori  privilege  of  choice  to  white,  mainstream 
respondents  more  than  it  does  to  visible  and  ethnic  minorities  due  to  the  demographic 
predominance  of  White  people  in  Canada. 

MOC’s  evaluation  has  demonstrated  the  elusive  nature  of  empirical  evidence  in 
addressing  systemic  change.  What  is  a successful  intervention?  MOC  has  allowed  at  least 
16  agencies  to  address  their  internal  and  external  barriers  to  diverse  parts  of  the  Calgary 
community.  This  process  should  be  considered  a very  real  part  of  the  public  organization’s 
mandate  by  the  organization’s  leaders,  but  all  too  often  is  not.  MOC  has  demonstrated  that 
developing  the  skills  to  better  serve  the  entire  community  is  part  of  the  responsibility  of 
providing  professional  services  and  not  an  optional  item  to  be  dealt  with  in  the  future  when 
economic  conditions  may  be  better. 
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3.6  MOC’s  Sustainability 

The  Stakeholders  Group  (see  Appendices  D and  E)  convened  March  19,  1997, 
discussed  ways  in  which  the  MOC  process  could  be  made  more  sustainable.  They  had  the 
following  suggestions  for  funders,  organization  leaders  and  for  the  change  process  itself. 

1.  establish  long-term,  core  funding  for  systemic  change  and  not  make  funding  dependent  on 
short-term  projects; 

2.  target  funding  toward  community  priorities  and  require  evidence  from  applicants  that  their 
agency  policies  support  accessibility; 

3.  develop  funding  and  grant  criteria  that  MOC,  or  similar  systemic  change  initiatives,  be 
focused  on  developing  community  capacities  and  be  based  on  a participatory,  community 
development  approach;  and 

4.  use  their  influence  at  the  federal  and  provincial  levels,  with  their  colleagues  in  order  that 
diversity  matters  are  seen  as  a concern  in  the  human  services. 

Stakeholders  also  suggested  that  MOC  would  have  a better  chance  of  longer-term 
sustainability  if  agencies: 

1.  were  clear  about  their  motivation  for  undertaking  system  change; 

2.  had  a better  understanding  of  their  training  needs; 

3.  developed  internal  training  capacity  so  that  diversity  skills  remain  in  the  organization, 
rather  than  leaving  when  individual  trainers  left  the  organization  or  the  process; 

4.  supported  shared  learning  with  others  in  their  sector,  and 

5.  understood  that  evaluation  of  system  change  is  critical  to  assess  whether  the  process  is 
actually  making  a difference  to  agency  accessibility. 
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4.0  Conclusions 


The  following  conclusions  emerge  from  observing,  listening  and  analyzing  quantitative  and 

qualitative  data  during  1990  to  1996.  See  Appendix  E for  time-lines  and  key  steps  during  the 

seven  years  of  the  project. 

■ Two  clear  messages  emerged  from  the  United  Way  of  Calgary  and  area  MOC  initiative: 

1.  Addressing  the  barriers  to  accessing  human  services,  based  on  the  dimensions  of 
diversity  which  exist  within  Calgary,  is  a long-term  and  difficult  undertaking,  challenging 
participants  both  personally  and  organizationally.  The  challenges  are  multi-faceted  for 
developing  inclusive  services  with  the  broader  community  externally,  as  well  as  for  staff 
wanting  their  organizations  to  be  more  open  internally;  and 

2.  Despite  numerous  glitches  and  problems,  and  despite  the  differential  impacts  of  MOC 
on  the  14  participating  agencies  and  the  various  sub-groupings  of  staff  and  board,  the 
Evaluators  found  that  the  MOC  intervention  raised  awareness  that  addressing  diversity  is 
critical  for  Calgary’s  human  services  sector. 

■ In  Calgary  (possibly  in  Canada  as  a whole)  there  is  a need  to  develop  more  organizational 
change  initiatives  similar  to  MOC,  as  well  as  developing  consciousness  about  the  critical 
need  to  address  equity  and  inclusivity  - as  a society,  across  the  professions  and 
individually.  At  the  same  time  the  stakeholders/key  actors  should  recognize  that  diversity 
is  a “public  good”  (i.e.,  diversity  is  good  for  all)  rather  than  the  domain  of  a particular  sub- 
group, for  instance  visible  minorities.  Thus,  the  means  of  any  such  change  process  are  the 
ends,  and  the  process  needs  to  be  implemented  in  such  a way  that  everyone’s  experience  is 
accepted  and  respected.  Therefore,  participants  from  the  mainstream/predominant  sub- 
group should  not  come  away  with  feelings  of  reverse  discrimination. 

■ The  four  constructs  (revealed  through  factor  analysis)  establish  an  important  framework  to 
study  and  measure  organizational  openness.  Freedom  to  speak  up  on  sensitive  issues,  is  a 
measure  of  basic  trust  within  the  organization,  while  the  other  three  factors-  management 
dedication  to  organizational  openness,  bringing  down  barriers  to  hiring/promoting, 
and  personal  dedication  to  organizational  openness,  are  key  to  a sucessfiil  MOC  change 
process.  However,  since  diversity  is  highly  complex  with  many  variables  and  local 
contexts,  there  is  still  a need  for  more  items/tests  which  measure  diversity  accurately. 

■ Yes,  it  is  possible  to  evaluate  the  success  of  a project  like  MOC.  But  the  qualitative  or 
quantitative  evaluation  design  must  be  culturally  sensitive  and  objective. 

■ While  this  study  has  established  some  content  and  process  criteria  for  assessing  success  in 
diversity  interventions,  until  there  is  a more  broadly  agreed  upon  list  of  specific 
“benchmarks”  and  standards  for  measuring  diversity  intervention  outcomes,  most 
evaluations  of  diversity  initiatives  will  likely  be  “naturalistic  evaluations”. 
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6.0  APPENDICES 
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Appendix  A 


The  Participants  in  the  United  Way  MOC  Process: 

1.  The  MOC  Committee  (199M996) 

Chair  - Talib  Nanji  (Board  Member) 

Niels  Agger-Gupta,  Maria  Astete,  Barb  Chang,  Judge  Cheryl  Daniel  (Board  Member),  Glynn 
Davis,  Vinay  Dey,  Kathy  Deyell , Pamela  Dos  Ramos,  Linda  Elefante-Thompson,  Michael 
Embaie,  Steffani  Feleski  (Board  Member),  George  Kumi  (1992-1994),  Esther  Lau,  Gerri 
Manyfingers,  Lai  Narang,  Pat  Pardo,  Charanjit  Sanghera,  Yvonne  Stanford,  Rosita  Thorpe, 
Teresa  Woo-Paw,  Elsie  Wuttunee  (Board  Member) 

2.  United  Way  MOC  Staff 

Wendy  Charlton  - Diversity  Facilitator,  MOC  Project  Development  - 1995-1996, 

Training  Team  Co-ordinator  - 1993-94,  Co-Co-ordinator  1994-95; 

Narmin  Ismail-Teja  - Diversity  Facilitator,  MOC  Service  Development  - 1995-1996, 

Training  Team  Co-Co-ordinator  - 1994-1995; 

Carole  Holmes  - Multicultural  Facilitator  - 1991-1995; 

Chris  Montfort  - facilitator  / trainer  / practicum  student  1996; 

Angie  Salvo  - Administrative  Support  - 1996  - 1997; 

Susana  Escobedo  - Administrative  Support  - 1995  - 1996 
Suphala  Rao  - Administrative  Support  - 1994  - 1995; 

Mary  Leung  - Administrative  Support  - 1991  - 1993 

United  Way  Barriers  Analysis  consultant  (1991/92)  - Julia  Melnyk  (Springboard  Consulting) 

5.  MOC  Committee  Catalyst  Connector  Sub-Committee: 

HUde  Moulding,  Calgary  Family  Service  Bureau, 

Cathy  Van  Bavel,  Distress  Centre/Drug  Centre  (chair), 

Yvonne  Stanford,  YWCA,  Cluster  1 (chair) 

Carol  Oliver,  Coalition  on  Family  Violence/  Cluster  4 

Romina  De  Silva,  Cluster  4 

Barb  Chang,  Technical  Resource  Centre,  Cluster  2 

Teresa  Woo-Paw,  Red  Cross,  Cluster  1 

Carole  Holmes,  MOC  Team 
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Wendy  Charlton,  Training  Team, 

Karen  Whyte,  Training  Team 

Niels  Agger-Gupta,  Alberta  Multiculturalism  Commission 

4.  United  Way  MOC  Training  Team 
Co-ordinator(s)  - Wendy  Charlton,  Narmin  Ismail-Teja 

Participants/Members  - Kathy  Briant,  Richard  Campbell,  Doris  Chabot,  Kathy  Deyell, 
Darcy  Foggo,  Gerard  Halpin,  Lisa  Hari,  Narmin  Ismail-Teja,  George  Kumi,  Lucretia 
Martenet,  Donna  McPhee,  Sara  Mitchell-Banks,  Nomogugu  Mgijima,  Pat  Pardo- 
Demiantschuk,  Caroline  Russell-King,  Barbara  Schleifer,  Dawn  Scott,  Keith  Seel,  Jean 
Slick,  Sylvia  Waller,  Teresa  Woo-Paw,  Karen  Whyte,  Niels  Agger-Gupta  and  Carole 
Holmes 

Train-the-Trainers  (June  1993)  Facilitators  - led  by  Reva  Joshee  (RJ3  Consulting)  and  including 
Norma-Jean  McLaren  (42nd  Street  Consulting),  Cecille  dePasse  and  Julia  Melnyk  (Springboard 
Consulting). 


5.  Participating  MOC  Agencies  and  Clusters: 

5.1  Cluster  One  (formed  May  1992)  - large  agencies  : 

Boy  Scouts  of  Canada  - (Change  Agents/representatives)  - 

John  Piera,  Hugh  Chalmers,  Linda  Maid,  Ray  Gayford; 

Boys  and  Girls  Clubs  of  Calgary  - Myma  Lynder,  Cheryl  Doherty,  Lois  Bladon,  Tim  Veitch, 

Chandrika  Mahadeva; 

Canadian  Mental  Health  - Trish  Cameron,  Elaine  Eskow,  Marg  Osborne; 

Canadian  Red  Cross  - Jean  SHck,  Jackie  Wright,  Corine  Frick,  Teresa  Woo-Paw, 

John  DaSilva-Spence; 

YWCA  - Eva  Friesen,  Yvonne  Stanford,  Rosemary  Lee,  Dorothy  Jones, 

Kerry-Lee  Schultheis,  Marcia  Davis; 

United  Way  of  Calgary  and  area  - Frank  Johnston 

Barriers  Analysis  Consultant  - Rebecca  Chan-AUen  (Delta  Learning  Organization,  Inc.) 
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5.2  Cluster  Two  (September  1992)  - (medium  and  small  agencies): 

Calgary  Birth  Control  Association:  Susan  Burrows-  Johnson,  Leslie  Gavel; 

Epilepsy  Association:  Kathy  Fyfe,  Roxanne  LeBlanc; 

Girl  Guides  of  Canada:  Bev  Wahl,  Patricia  Verburgt; 

Technical  Resource  Centre:  Jim  McLaughlin,  Barb  Chang; 

Volunteer  Centre:  Martha  Parker,  Keith  Seel,  Georgette  Thrasher 

Barriers  Analysis  Consultant  - Margery  Knorr  and  Norma  Farquerson 

5.3  Cluster  Three  (January  1993)  - five  counselling  agencies: 

Calgary  Family  Service  Bureau  - Don  Karst,  Hilde  Houlding; 

Catholic  Family  Service  - Greg  Campbell,  Jean  Leong,  Kathy  Tyndale; 

Distress  Centre/Drug  Centre  - Jeanette  McEachem,  Cathy  Van  Bavel,  Dell  Stephens; 

Jewish  Family  Service  - Hope  Kahane,  Michele  Doctoroff,  Anna  Sternberg; 

Pastoral  Institute-  Robbie  Babins-Wagner,  Lois  Heard. 

Barriers  Analysis  Consultant:  Brian  Hoffart  and  Irene  Hoffart  ( Synergy  Research  Group,  Inc.) 

5.4  Cluster  Four  (summer  1992)  - developed  somewhat  independently  of  the  first  three  - 
co-ordinated  by  Coalition  on  Family  Violence  co-ordinators:  Romina  Da  Silva  & Carol  Oliver; 
and  included: 

Calgary  Immigrant  Aid  Society  - Hadassah  Ksienski; 

Calgary  Immigrant  Womens’  Association  - Linda  Elefante  - Thompson; 

Calgary  Women’s  Emergency  Shelter  - Susan  Gardiner 

Catholic  Immigration  Society  - John  Mungham,  Fairborz  Baiijanian; 

Council  of  Sikh  Organizations  - Charanjit  Sanghera; 

Discovery  House  - Norma  Peters; 

Sheriff  King  Home  (YWCA)  - Fran  Smith 

Barriers  Analysis  Consultant:  (1993  - funded  separately  by  the  federal  department  of  Canadian 
Heritage)  Julia  Melnyk  (Springboard  Consulting  Inc.) 

(1995)  Margery  Knorr  and  Norma  Farquerson 
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5.5  Cluster  Five  (created  in  1995) 

formed  at  the  request  of  agencies  dealing  with  people  in  trouble  with  the  law,  and  included: 
Alberta  Seventh  Step  Society:  Jim  Osborne,  Esther  Jackson; 

Elizabeth  Fry  Society:  Michelle  Clarke,  Bev  Frizzell,  Barb  Innes,  Deborah  Bartlett; 

John  Howard  Society:  Gordon  Sand,  Ian  Cundliffe,  Gladys  Bolinski,  Vem  Fielder 

Barrier's  Analysis  Consultant:  Brian  Hoffart  and  Irene  Hoffart  ( Synergy  Research  Group,  Inc.) 

6.  Circles  Process 

6.1  Change  Agents  Circle: 

Pam  Greer;  Gerard  Halpin,  John  DaSilva-Spence  - (Red  Cross) 

Chandrika  Mahadeva,  Teri  Adair,  Monica  Pohomann  - (Boys  & Girls  Clubs) 

Norma  Cody  - (YMCA) 

Nadine  Nesbitt,  Lois  Sutterland  - (Calgary  Legal  Guidance) 

6.2  Leadership  Circle: 

Myma  Linder  - (Boys’  and  Girls’  Clubs) 

Susan  Burrows-Johnson  - (Calgary  Birth  Control  Association) 

Jean  Slick  - (Canadian  Red  Cross) 

Hope  Kahane  - (Jewish  Family  Services) 

DanieUe  Aubry  - (Calgary  Communities  Against  Sexual  Abuse  - CASA) 

Ed  Johnston  - (United  Way  of  Calgary  and  area) 

6.3  Facilitators  Circle 
Lois  Bladon;  Chandrika  Mahadev  - (Boys’  and  Girls’  Clubs) 

Suzzanne  Rosebrugh;  Cathy  Van  Bavel  (Ghinescu)  - (Distress  Centre/Drug  Centre) 

Narmin  Ismail-Teja;  Chris  Monfort  - (United  Way  of  Calgary  and  area) 

Romina  Da  Silva  - (Calgary  Coalition  on  Family  Violence) 

Jessica  Ayala;  Marcia  Davis  - (YWCA) 

Pat  Pardo  - (Canadian  Mental  Health  Association) 

Peggy  Bevens  - (Red  Cross) 


6.4  Resource  Circle 
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Wendy  Charlton,  Brenda  Aries,  Valerie  Barr,  Christine  Monfort-  (United  Way  of  Calgary  and 
area) 

Angela  Stephen,  Greg  Bielecki,,  Jim  Connolly,  John  Da  Silva  Spence;  Natasha  Chetty  - 
(interested  community  members) 

Rebecca  Chan  Allen  - (Delta  Learning  Organization) 

Niels  Agger-Gupta  - (Alberta  Multiculturalism  Commission) 


6.5  Quality  Circle 

Colleen  Hauck,  Liza  Choi  - (Canadian  Red  Cross) 

Frank  Johnston  - (United  Way  of  Calgary  and  area) 

Lisa  Chan  - (Calgary  Chinese  Elderly  Citizen  Association) 
Hildie  Moulding  - (Calgary  Family  Service  Bureau) 
Leveme  Campbell  - (YWCA) 

Marva  Ferguson  - (CASA) 


6.  6 Project  Circle 

Wendy  Charlton,  Narmin  Ismail-Teja,  Chris  Monfort,  Susan  Escobedo  - (United  Way  of 
Calgary  and  area) 

Rebecca  Chan  Allen  - (Delta  Learning  Organization) 

7.0  Participants  at  the  March  19, 1997  Stakeholders  Meeting 
held  at  Alberta  Community  Development  - 301  - 11  Avenue  S.W. 

Teresa  Woo-Paw  - (Calgary  Chinese  Community  Service  Association) 

Patricia  Bond,  Frank  Johnston,  Talib  Nanji  - (United  Way  of  Calgary  and  area) 

Wendy  Charlton,  Narmin  Ismail-Teja,  Chris  Monfort  - (Diversity  Learning  Institute) 
Cathy  Keough-Ghinescu  - (Distress  Centre/Drug  Centre) 

Hildie  Houlding  - (Calgaiy  Family  Service  Bureau) 

Susan  Burrows-Johnson  - (Calgary  Birth  Control  Association) 

Janet  Wager -(YWCA) 

Amal  Umar  - (Canadian  Heritage  -Government  of  Canada) 

Philip  Cox  - (Plan-.Net  2000  Management  & Consulting) 

Urmil  Chugh  - (Independent  Consultant/Evaluator/Researcher  and  also  Plan:Net) 

Niels  Agger-Gupta  - (Alberta  Community  Development/  Evaluator) 
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1996  Workforce  Survey  Mtroduction  Letter  - Page  1 


Your  Observations  on  Your  Organization  and  the 
Community  it  Serves  


Cover  Note 


An  Assessment  Tool  for 
Understanding  Diversity  in 
Community  Organizations 

This  survey  questiormaire  is  designed  to  give  an 
organizational  profile  of  values  and  attitudes 
about  diversity  in  the  workplace.  One  verson  of 
the  instrument  is  intended  for  staff,  the  other  for 
volunteers. 

TTie  questionnaire  grows  out  of  a multicultural 
organizational  change  initiative  of  the  United 
Way  of  Calgary  and  Area.  Nineteen  local  sodal 
service  organizatioru  are  involved  in  this  three 
year  project  to  identify  and  dismantle  banriers  to 
consumer  service,  employment  and 
participation 

During  the  Summer,  Fall  and  Winter  of  1993/94 
representatives  of  all  nineteen  organizations 
participated  in  the  design  of  the  instrument,  and 
then  administered  it  to  their  staff  and 
volunteers  2.  The  consulting  firm,  PLAN:NET, 
co-ordinated  the  design  phase  and  is  currently 
entering  and  analysing  the  faults. 

This  questionnaire  is  a to^  for  collecting 
baseline  information  about  an  organization  at 
the  outset  of  a change  proofs.  Information 
generated  by  the  qu^onnake  will  assist 
participating  oiganizatiom  develop 
organization  change  plans.  InCdgary,  a 
streamlined  version  of  this  instrument  will  be  re- 
applied eighteen  months  after  the  baseline 
questionnaire  in  order  that  the  d^ree  of 
organizational  change  can  be  assessed. 

A Tool  Still  in  the  Making... 

This  is  not  a perfect  instrument.  The 
questiormairt  is  long  and  broad  in  scope.  Some 
respondents  have  criticized  it  for  being 
ambiguous.  It  is  long  because  we  are  searching 
for  success  indicators  of  organizational  change. 

It  may  be  ambiguous  because  we  are  presently 
honing  in  on  words  and  their  definitions. 

Tho^  of  us  working  with  the  instrument  are  still 
learning  what  it  can  tell  us  about  the  change 
process  and  about  people's  attitude  towards 
diversity.  As  we  deepen  our  analysis  of  the  data 


we  will  understand  its  value  better.  In  turn,  this 
understanding  will  influence  how  we  put  future 
versior^  of  the  imtmment  together. 

Please  use  this  tool  with  caution . Tailor  it  to 
your  own  community,  and  only  use  it  as  part  of 
a larger  organizational  change  process.  Our 
experience  is  that  staff  and  volunteers  need  to 
understand  why  they  are  being  asked  these 
questions  before  they  see  the  questionnaire.  The 
questions  wiU  likely  set  off  an  agency  wide 
discussion  and  create  expectations  that  changes 
in  j>oiiey  and  programming  are  forthcoming. 

On  the  other  side  of  this  sheet  is  a sample  cover 
letter.  Among  other  things  the  letter  addre^es 
two  golden  rules  - that  a)  the  respondent  know 
her/his  contribution  will  be  kept  confidential 
and  anonymous,  and  b)  the  respondent  know 
tiiat  she/he  may  choose  to  answer  any 
questioa 

If  you  have  any  questions  or  comments  about 
the  instrument,  please  call  or  write  to: 

Kitty  Chugh  or  PhiMp  Cox 
PLAN:NET 

1225a  Kensington  Road  NW 
Calgaiy  Alberta 
T2N3PS 

Tel.  (403)  270-0217 

Fax.  (403)  270-8672 

or. 

Carole  Holmes 

MOC  Co-ordinator 

United  Way  of  Calgary  and  Area 

120  13th  Ave  SE 

Calgary  Alberta 

T2G  1B3 

Tel.  (403)  263-0720 

Fax.  (403)  266-1271 

If  you  use  or  adapt  the  instrument  please  let  us 
know  how  it  goes,  we  would  like  to  learn  from 
your  experience! 

March  11, 1994 


^ This  project  is  funded  by:  Citizenship  and  Heriliage  Secretariat,  Government  of  Alberta;  the 

Kahanoff  Foundation;  the  United  Way  of  Calga^  and  Area;  and  Multiculturalism  and  Citizenship, 
Government  of  Canada. 

2 The  design  of  the  instrument  also  inspired  by  the  following  sources: 

Simoi^,  Dr.  G.F.  (1990)  The  Questions  of  Diversity:  Assessment  Tools  for  Organizations 
and  Individuals.  Amherst,  MA:  ODT  Incorportated. 

Thomas,  B.  (1987)  Multiculturalism  at  Work:  A Guide  to  Organizational  Change. 

Toronto:  YWCA. 

Consultation  with  staff  of  the  Citizenship  and  Heritage  Secretariat,  Government  of 
Alberta,  Calgary 
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1996  Workforce  Survey  Introduction  Letter  - Page  2 


Sample  Cover  Letter  for  the  Workforce  Survey 

Dear  Member  of  Staff/ Volunteer: 

Uh  oh!  another  heavy  going  questionnaire  I hear  you  say.  Actually,  it  may  look  lengthy  but  it 
should  only  take  you  25  minutes  or  so.  What  is  it  about?  Its  about  our  agency,  the  people  who 
keep  it  running  each  day,  and  the  people  it  serves.  Why  these  questions? 

Over  the  past  few  months  you  may  have  been  hearing  about  this  project  geared  to  making 

as  open  as  possible  to  all  people  in  our  City  who  can  benefit  from  the  programs  and 

services  we  offer.  This  questionnaire  is  designed  to  help  us  measure  where  we  are  now,  before 
the  project  really  gets  underway. 

The  word  "all  ” includes  people  across  different  cultures,  ethnic  backgrounds  and  language 
groups,  people  with  mental  and  physical  disabilities,  men  and  women,  and  people  of  different 
income  and  education  levels.  "AH"  includes  both  individuals  who  are  part  of  Calgary's 
"mainstream"  society  and  those  who  make  up  minority  groups  in  the  City. 

Being  "open"  to  people  from  different  backgrounds  and  experiences  means  two  things:  a) 
making  sure  that,  as  far  as  possible,  programs  and  slices  meet  the  needs  of  people  from  diverse 
backgrounds  and  experiences,  and  b)  building  a work  place  where  people  from  a variety  of 
backgrounds  and  experiences  can  work  well  together  and  reflect  the  community(ies)  which  the 
agency  intends  to  serve.  Why  the  interest  in  "openness"?  The  population  of  our  City  is 
changing  fast  - the  communities  we  currently  serve  are  becoming  more  diverse.  It  simply  makes 
practical  and  ethical  sense  to  keep  up  with  these  changes. 

chose  to  participate  in  this  organizational  change  project  lead  by  the  United 
Way  of  Calgary  and  Area.  Our  agency  is  one  among  19  involved  in  the  Project.  Together,  we 
have  committed  ourselves  to  examine  our  ability  to  reach  all  potential  consumers  with  our 
agency's  offerings  and  to  put  together  a plan  to  help  us  improve  our  effectiveness  at  meeting 
community  needs. 

In  order  to  move  forward,  we  need  to  gather  information  from  agency  staff  and  volunteers  to 

will  help  us  establish  the  current  status  in  and  how  it  is  changing  as  a result  of 

the  project.  You  can  make  a difference  to  our  agency’s  ability  to  be  more  open  by  responding  to 
the  questions  in  the  enclosed  questionnaire  candidly.  There  are  no  right  or  wrong  answers.  The 
questionnaire  has  two  parts  to  it.  Part  I asks  for  your  opinions  about  day  to  day  happenings  in  the 
workplace  and  about  the  clients  and  consumers  who  use  our  services.  Part  II  asks  about  you  and 
your  role  in  the  agency. 

Some  questions  are  personal.  In  Part  Two,  for  example,  we  ask  you  questions  about  income, 
household  composition  and  religion.  We  do  this  because  these  topics,  among  others,  are 
essential  to  understanding  the  diversity  of  our  workforce.  Be  assured  that  your  responses  will  be 
kept  CONFIDENTIAL  and  ANONYMOUS.  Once  completed,  your  sealed  envelope  will  be 

collected  by  and  bundled  up  for  processing.  The  outside  consultant, 

PLANiNET,  will  enter  the  data  and  summarize  the  results  so  that  no  respondents  will  be 
identifiable.  PLAN;NET  will  make  some  general  observations  of  the  data  for  the  overall 
evaluation  of  the  United  Way's  change  project,  and  then  provide  each  agency  with  its  own  set  of 
data.  Each  agency  will  then  use  this  information  for  its  own  change  process.  The  questionnaire 
has  been  reviewed  by  the  Alberta  Human  Rights  Commission. 

Please  note  - you  may  choose  not  to  answer  any  question  for  whatever  reason. 

Thankyou  very  much  for  participating  in  this  survey!  Please  seal  your  finished  questionnaire  in 

the  envelope  provided  and  pass  it  along  to  by  . 

Alternatively,  please  mail  it  directly  to  X.  Should  you  have  any  questions  please  call  X. 

Sincerely 


(signed  by  individual  from  agency) 
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1996  Workforce  Survey  Instniment  - Page  1 


Your  Observations  on  Your  Organization 
and  the  Community  it  Serves 

This  is  confidential.  You  may  choose  not  to  answer  any  question. 
Part  One:  About  (Agency  Name)  and  the  Community  it  Serves 

Over  the  past  three  years  your  organization  has  participated  in  an  organizational  change  process. 
You  might  know  the  process  as  your  agency’s  (insert  appropriate  usage  for  each  agency).  The  idea  of 
t)ie  organizational  change  process  is  to  help  your  agency  better  serve  community  members,  keeping 
in  mind  their  ethnicity,  language,  ability,  income,  gender,  sexual  orientation  or  other  ways  people 
may  experience  discrimination.  Opening  up  organizations  to  people  of  different  backgrounds  requires 
two  kinds  of  change:  a)  internal  change  - creating  a culhire  where  staff  and  volunteers  from  diverse 
backgrounds,  circumstances  and  experiences  can  work  together,  and  b)  external  changes  - making 
the  programs/services  attractive  and  accessible  to  a wider  range  of  potential  users.  The  terms. 
Multicultural  Organization  Change,  Diversity,  Consumer  Control  and  Choice,  and  Agency  Access 
combine  to  form  an  important  part  of  the  Future  Ways  initiative  of  the  United  Way  of  Calgary  and 
Area. 

A.  A Question  of  Priority 

la.  In  your  opinion,  how  high  a priority  does  your  management  place  on  increasing 

organizational  openness  (e.g.  “multicultural  organizational  change”,  “diversity”,  etc.)  to  the 
comunity  it  serves?  (please  check  one  box) 

Top  High  ' Medium  Low  Not  at  all  Don’t  Know 

□ □ □ □ □ □ 


lb.  How  high  a priority  do  you  personally  place  on  increasing  organizational  openness  (e.g. 
“multicultural  organization^  change”,  “diversity”,  etc.)?  (check  one  box  only) 


Top 

High 

Medium 

Low 

Not  at  all 

Don’t  Know 

□ 

□ 

□ 

□ 

□ 

r~ 

B.  Looking  at  a Single  Program  or  Service  Offered  by  Your  Organization 

The  following  questions  concern  the  consumers/clients  of  your  organization.  They  ask  you  to 
estimate  the  makeup  of  consumers/clients  in  the  program  or  service  that  you  are  most  famiHar 
with.  There  are  nine  characteristics  of  diversity  (e.g.  age,  gender)  given  for  you  to  consider.  The 
last  question  in  this  section  asks  you  how  the  makeup  of  your  chents/consumers  has  changed 
(if  at  all)  over  the  time  of  the  organizational  change  process. 

1.  Name  one  program  or  service  offered  by  your  organization  which  you  are  most 
knowledgeable  about. 


2a.  Please  describe  the  characteristics  of  the  consumers/clients  who  normally  participate  in  the 
program  or  service  identified  in  question  #1.  (estimate  the  proportion  of  clients  in  each  of  the 
following  categories) 


• Age 

under  13 

13-24 

25-39 

40-55  56  & over  Don’t  know 

% 

% 

% 

% % % 

• Gender 

Male 

Female 

Don’t  know 

% 

% 

% 
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Income 

Low 

0/ 

Middle 

% 

High 

% 

Don’t  know 

0/ 

Family 

/o 

Single 

One  Parent 

Two  parent 

/O 

Extended 

Don’t  know 

make  up 

(e.g.  other  relaUves) 

% 

% 

% 

% 

% 

First 

English 

French 

Aboriginal 

Chinese 

German 

Spanish 

Italian 

language 

% 

% 

(Canada) 

% 

% 

% 

% 

% 

Polish 

Viemamese 

Dutch 

Punjabi 

Ukrainian 

Other 

Don’t  know 

% 

% 

.% 

% 

% 

% 

% 

Race/ 

White 

Chinese 

South 

Black 

Arab/ 

Philippino 

South  East 

Ethnicity 

Asian 

West  Asian 

Asian 

(as  defined  by 

Statistics  Canada  for 

the  1996  Census) 

% 

% 

% 

% 

% 

% 

Latin 

Japanese 

Korean 

Other 

Don’t  know 

% 

% 

% 

% 

Ability 

People 

People 

Don’t 

without  a 

with  a 

know 

Disability 

Disability 

% 

% 

% 

Sexual 

Homo- 

Hetero- 

Bi- 

Don’t 

orientation 

sexual 

sexual 

sexual 

know 

% 

% 

% 

% 

* Religion/  Christian  Muslim  Hindu  Buddhist  Jewish  Aboriginal  Other  Don’t  know 
Spirituality  Spirituality 

% __  % % % % % % 


2b.  If  you  participated  in  the  1993  survey,  complete  the  following,  (please  check  one  box.  If  you  are 
new  to  the  agency  please  move  on  to  Section  C).  Now,  using  the  same  categories  below,  please 
describe  the  changes  (if  any)  oveir.&e  last  three  ye^s,  in  the  make  up  of  the  chents  for  this 
;|piBlm  or  ser#BHi  \ 

Mudoiless  Somewhat  >Same  Somewhat  Much  more  Don’t 

diverse  less  diverse  "-  as  now  more  diverse  diverse  laiow 

now  now  (iib€l»|nge)  , now  ^ 

• Age (i.e.  less  th^  lSyrs,  13-24,  HS’SSt,  40-54,  more  dian  55  yrs)  ^ 

g;;|3 

'' 

• . (i.e.  malei  fM^e) 

Illp  jiiig 

^|||||| IBB 

• Income  (i.e.  low^  middle,  high)  ;//  i 

iliiig  nil  , 'p 

Why?  ' -'1 
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Question  2b  continued 


Much /ess 

Somewhat 

Same 

Somewhat 

Much  more 

Don’t 

diverse 

/ess  diverse 

as  now 

more  diverse 

diverse 

know 

now 

now 

(no  change) 

now 

now 

Family  Makeup  (i.e.  single,  one  parent,  two  parent,  extended) 

paiO 

Why?  — — — 

• First  Language  (e.g.  English,  French,  Chinese,  Spanish),  i 

j||g  :|0  l|i|  Fi|5  im 

5W|||| • " aiiiiiii 

• Race/Ethnidty  (e.g.  White,  Chinese,  South  Asian)  ; ^ 

^IIIQ  ':lg  :|IB  ■:  IB  ||iD  i|R 

.v|l||jj 1111111 — -lii ijillii |ji|iij 

• Ability  (i.e.  people  ivifh  a disability,  people  without  a disability) 

:||||  IB  I'-n  ||B  liMl 

'Why?; egg leyg ' SiHB 

• Se^ai  Orientation  CLet  homosexual,  bisexual  or  heterosexual)  ” } 

; ,□  iig  ^.--d  'Bd  v6 

|||||i| ijilBI -IMil 

• Rdigion/SpirituaKty  (i.e.  Christian,  Muslim,  Hindu,  Jewish,  Buddhist,  Aboriginal  spirituality, 

|j|B  ii|o  \Bf  -'O  iig 

'Wiiii iigiii li: 

C.  Your  Organization  and  Diversity 

1 . How  closely  do  you  feel  the  following  statements  describe  the  present  situation  in  your  organization. 
The  statements  concern  your  organization’s  openness  to  people  of  diverse  backgroimds  (e.g.  income, 
education,  ethnicity,  ability,  age,  sexual  orientation)  (For  each  statement,  please  mark  only  one  box  with 


an 

Strongly 

disagree 

Disagree 

oy||||i| 

Neith^ 
agree  nor 
disagree 

Aj^ee 

- 

Strongly 

Agree 

Don’t 

Know 

1 . My  organization  provides  quality  ser\nce  to  people  oldiverse  backgrounds. 

•Iliji  'lo  lljig!  ||H 


2.  There  is  conflict  (e.g.  frustration  and  anger)  when  diversity  issues  are  raised  in  our  organization. 

:iliB;  Jd  ..jjp  s|g  -yQ  iff>n 

3.  Staff  have  created  an  open /brum  for  discussion. 

20:  sllCI  ';*□  .-■-ifl  ^ : □ 

4.  There  is  an  overall  plan  to  deal  with  diversity  issues  in  our  organization. 


□ 

□ 

LI 

" o:  • 

i*B 

5.  I hear  sexist  remarks  m my  organization. 

□ D 

□ 

6.  I hear  racist  remarks  iii  my  organization. 

□ □ 

D 

5- 

□ 
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Strongly  Disagree  Neither  Agree  Strongly  Don*t 

disagree  agree  nor  Agree  KnoW 

disagree 

7.  There  is  confusion  about  how  to  communicate  with  people  who  appear  different. 

□ ,D  D 'D  .□ 

8.  People  are  not  treated  fairly  because  they  appear  different. 

wiiB:  lie  . :B  ■' lS  JID 

9.  Staff  are  motivated  to  work  together. 

|||B  |B  ■■vS 

10.  Volunteers  feel  valued  for  the  strengths  they  bring  to  the  organization.  ^ 

.c  iiy  Q:  iiigi 

1 1.  Staff  know  to  whom  they  should  refer  chents/consumers  with  specialized  needs 
(e.g.  language,  wheelchair  access). 

;gg|  ilB  Jg  HIB  :iB  ||Bi 

12.  Clients/consumers  with  specialized  needs  (e.g.  person  who  does  not  speak  English,  person  with 
a disability)  expect  services  that  the  agency  cannot  provide. 

"||0  lllli  imi  liiB  /Q 

13.  Our  agency  only  thinks  of  the  “mainstfeam”  consumer  when  we  advertise  our  prograans. 

IB  iljig  ; jiH  ||||H  ||B  jlp 

14.  There  is  adequate  trataing  for  staff  to  deal  with  diversity  issues  and  needs.  : - U > 

SlB  'HP  :iiP  M3  .ilB 

1 5.  There  is  adequate  tracing  for  volunteers  to  deal  with  diversity  issues  and  needs,  v . = 

jjp  lljlH  |||H  ;ji||3  iijB 

16.  I will  have  difficulty  being  supervised  by  someone  froni  the  opposite  sex. 

;jg  810  |||j3  jUfj 

17.  I will  have  difficulty  being  supervised  by  someone  fford  an  ethnic  group  different  frommy  own. 

■IB  111  1113  ;iiQ 

18.  I will  have  difficulty  being  supervised  by  someone  from  a race  different  from  my  own. 

'■g  IIP  liB  iiit3 

19.  Opening  up  the  organization  will  make  my  job  more  secure. 

g g iiiB  tS 

20.  I will  have  difficulty  working  with  people  whose  sexual  orientation  is  different  from  my  own. 

, .In  :gi|B  ■B  lip  1:3  i|B 

21.  I am  too  busy  doing  my  regular  work  to  deal  with  organizational  openness  issues. 

'IS  ilB  ■ B IIS  -v-S  IIB 

22.  Thore  is  commitment  to  change  at  the  “top”  (e.g.  pohey  level,  senior  management)  of  the 
organization. 

□■  p p g -o 

23.  My  co-workers  need  tdbe  more  understanding  of  how  people  in  minority  groups  feel. 

□ □ □ G G^  G 
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D.  Your  Overall  Feelings  about  this  Organizational  Change  Process 

Please  use  this  section  to  tell  us  how  you  think  the  Futureways  process  has  affected  your 
organization,  you  personally,  your  profession,  and  the  larger  Calgary  community.  There  are 
four  questions,  each  with  a scale  from  1 to  10.  For  each  question,  please  circle  the  number 
which  most  closely  matches  your  feeling,  and  then  write  a few  words  to  explain  why  you  feel 
this  way.  If  you  do  not  feel  able  to  answer  any  of  these  questions,  please  move  on  to  Part  Two. 

Effect  on  Your  Organization... 

la.  Has  the  organizational  change  process  made  any  difference  to  your  organization? 


A lot  of 
Difference 


Some 

Difference 


10 

No 

Difference 


lb.  Overall,  has  this  change  process  been  good  or  bad  for  your  organization? 


1 2 3 

Good 

Why  do  you  feel  this  way? 


8 9 


Neither 
Good  nor  Bad 


10 

Bad 


Effect  on  you  personally... 


2a.  Has  the  organizational  change  process  made  any  difference  to  you  personally? 


A lot  of 
Difference 


Some 

Difference 


No 

Difference 


2b.  Overall,  has  this  change  process  been  good  or  bad  for  you  personally? 

123456789 

Good  Neither 

Good  nor  Bad 


10 

Bad 


Why  do  you  feel  this  way? 
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Effect  on  Your  Profession  and  the  Community  at  Large... 

At  least  20  social  service  organizations  in  Calgary  have  carried  out  change  activities  to  help  their 
organizations  better  serve  community  members.  Are  these  activities  affecting  the  practices  of  the 
social  service  professions  (e.g.  social  work,  nursing,  counselling,  psychology)?  If  you  are  working 
in  a professional  capacity,  please  answer  questions  3a  and  3b.  If  they  do  not  apply  to  you,  please 
move  on  to  question  4. 

3a.  Have  these  organizational  change  initiatives  (across  Calgary  social  service  agencies)  made 
any  difference  to  your  profession? 


123456789  10 

A lot  of  Some  No 

Difference  Difference  Difference 

Why  do  you  feel  this  way  


3b.  What  is  your  profession? 


What  about  the  effect  of  these  organizational  change  activities  (across  city  agencies)  on  the  health 
and  social  service  community  in  Calgary... 

4.  As  a result  of  efforts  to  improve  the  openness  of  organizations,  have  you  seen  any  change 
in  the  way  health  and  social  services  are  provided  to  Calgarians? 


1 2 

3 

4 5 

6 

7 

8 

A lot  of 

Some 

Change 

Change 

Why  do  you  feel  this  way 


9 10 

No 

Change 


Part  Two:  About  IVIe 

This  last  part  of  the  survey  seeks  information  about  you.  We  ask  for  this  information  so  that  we 
can  create  a picture  of  who  makes  up  your  organization.  This,  in  addition  to  the  information 
gathered  in  Part  One,  will  help  your  agency  understand  its  organizational  culture.  Once  again,  all 
the  information  you  provide  is  collected  anonymously  and  will  only  be  used  in  combination  with 
the  responses  of  others.  Your  responses  will  be  kept  private.  Even  so,  you  may  choose  not  to 
answer  any  question. 
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la.  My  role  in  this  organization  is...  □ staff  (go  to  lb.)  □ volunteer  (go  to  Ic.) 

lb.  As  a staff  member,  I work  in  my  organization  as  a...  (check  only  one  please) 

□ Building  Support  Staff  (e.g.  grounds,  janitorial)  □ Manager 

□ Clerical  Staff  (e.g.  secretarial,  reception)  □ Senior  Manager 

□ Program  Staff  (e.g.  counselor,  youth  worker) 

I work...  (check  one)  □ Full  time  □ Part  time 

lc.  As  a volunteer,  I am  a...  (check  only  one  please) 

□ Board  Member  □ Other 

2.  The  length  of  time  I have  been  with  the  agency  is...  

3.  My  gender  is...  □ Male  □ Female 

4.  My  age  is... (check  one)  □ under  18  yrsD  18-24  □ 25-44  □ 45-59 

□ 60-69  □ 70+ 

5.  I can  SPEAK  the  following  languages...  (please  list  the  languages  below  and  for  each  language 
place  one  “x”  in  the  column  which  matches  your  ability) 


Language(s)  spoken 


Fluently 

□ 

□ 

□ 

□ 


Moderately 

□ 

□ 

□ 

□ 


Poorly 

□ 

□ 

□ 

□ 


6.  I can  WRITE  in  the  following  languages...  (please  list  the  languages  in  the  box  below  and  for 
each  language  place  one  “x”  in  the  column  which  matches  your  ability) 


Language(s)  written  Fluently 

Moderately  Poorly 

n 

□ 

□ 

n 

□ 

□ 

n 

□ 

□ 

_ _ _ _ _ n 

n 

□ 

My  highest  formal  education  level  is... 

{please  check  the  ONE  best  answer) 

□ 

Grade  9 or  less 

□ 

some  college,  technical  school  or  university 

□ 

some  high  school  (Grade  10  - 12) 

□ 

completed  undergraduate  degree 

□ 

completed  high  school 

□ 

completed  graduate  or  professional  degree 

□ 

trades  certificate  or  diploma 

□ 

other  (specify) 

8.  My  rehgion/spiritual  orientation  is 

9.  I consider  myself  to  be  a person  with  disabihties 

10.  I was  bom  in  Canada... 

If  “no”,  I have  been  in  Canada  years 


□ Yes 

□ Yes 


□ No 

□ No 
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1 1.  I consider  myself  a visible  minority  in  Calgary...  □ Yes  □ No 

12.  My  ethnic  or  cultural  background  is...  

13.  My  personal  annual  income  is  (check  ONE  category  only  please) 


□ Less  than  $5,000 

□ 55,000  - 14,999 

□ $15,000-  24,999 

□ $25,000-44.999 

□ $45,000  and  over 

THANKS  VERY  MUCH! 
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MiKi 


Table  C-1.  Gender  and  Age  (in  Clategories)  of  the  1993  and  1996  Respondents 


Staff 

Board 

1993 

(n=475) 

1996 

(n=258) 

1993 

(n=137) 

1996 

(n=55) 

Gender 

• Male 

83  (18%) 

48  (19%) 

46(34%) 

19  (35%) 

• Female 

379  (80%) 

196  (77%) 

80  (58%) 

34  (63%) 

• NR 

13(3%) 

11  (14%) 

11  (8%) 

1(2%) 

Age 

• Under  18  yrs 

0 

0 

0 

• 18-24  yrs 

47  (10%) 

0 

1(2%) 

• 25-44  yrs 

276  (58%) 

73  (53%) 

22  (42%) 

• 45-59  yrs 

121  (26%) 

57  (42%) 

25  (46%) 

• 60-69  yrs 

15(3%) 

4(30%) 

3 (6%) 

• Over  70  yrs 

2 (0.4%) 

1(2%) 

2(4%) 

• NR 

14(3%) 

2(2%) 

1(2%) 

NR=  Non-response 
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Table  C-2.  1993  and  1996  Respondents’  Formal  Education 


Staff 

Board 

1993 

1996 

1993 

1996 

(n=475) 

(n=258) 

(n=137) 

(n=55) 

Formal  Education 

• £ Grade  9 

2 (0.4%) 

0 

0 

0 

• Smne  High  School 

11  (2%) 

8(3%) 

1(1%) 

0 

• Completed  High  School 

23  (5%) 

11  (4%) 

2(2%) 

2(4%) 

• Trade  Certificate  or 

Diphmia 

58  (12%) 

27(11%) 

15  (11%) 

5(9%) 

• Some  Cdlege,  Technical 

Schocd  or  University 

125  (26%) 

46  (18%) 

16  (12%) 

9 (17%) 

• Ungradnate  Degree 

115  (24%) 

57  (22%) 

34(25%) 

14(26%) 

• Graduate  or  Professkmal 

Degree 

111  (23%) 

94  (37%) 

68  (50%) 

20  (37%) 

• Other 

19  (4%) 

8(3%) 

1(1%) 

3 (6%) 

• NR 

11  (2%) 

4(2%) 

0 

1(2%) 

NR = Non-Respondence 
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Table  C-3.  1993  and  1996  Respondents’  Religions 


Staff 

Board 

1993 

1996 

1993 

1996 

(n=475) 

(n=258) 

1 (n=137) 

(n=55) 

Religion 

• Christian 

228  (48%) 

131  (51%) 

75  (55%) 

33  (61%) 

• Muslim 

3(1%) 

2(1%) 

1(1%) 

0 

• Hindo/Sikh 

2 (0.4%) 

3 (1%) 

1(1%) 

0 

• Bnddist 

2 (0.4%) 

0 

0 

0 

• Jewish 

12(3%) 

6(3%) 

9(7%) 

0 

• H<distic 

1 (0.2%) 

2(1%) 

0 

0 

• Agnostic 

6(1%) 

10  (4%) 

6(4%) 

1(2%) 

• Atheist 

6(1%) 

6(2%) 

1(1%) 

0 

• None 

15(3%) 

0 

7(5%) 

0 

• Other 

47  (10%) 

22  (9%) 

9(7%) 

3 (6%) 

• NR 

145(31%) 

73  (29%) 

27  (20%) 

15  (28%) 
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Table  C-4.  Respondents’  Perceived  Visible  Minority  Status  and  Whether  or  not  Bom  in  Canada. 


Staff 

Board 

1993 

1996 

1993 

1996 

(n=475) 

(n=258) 

(n=137) 

(n=55) 

Bnrn  in  ranadu 

• Yes 

374(79%) 

185  (72%) 

108  (79%) 

49(91%) 

• No 

89  (19%) 

65  (25%) 

27  (20%) 

5(9%) 

• NR 

12(3%) 

5(2%) 

2(2%) 

0 

Perceived  Visible 

Minoritiv  Status 

• Yes 

62  (13%) 

37  (14%0 

16  (12%) 

4(7%) 

• No 

388  (82%) 

209  (82%) 

118(87%) 

47  (87%) 

• NR 

25(5%) 

9(3%) 

3(2%) 

3(6%) 

Perceived  Disability 

Status 

• Yes 

20  (4%) 

9(3%) 

6(4%) 

4(7%) 

• No 

432(91%) 

239  (94%) 

128  (93%) 

48  (89%) 

• NR 

23(5%) 

7(3%) 

.... 

2(4%) 

NR= Non-response 
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Table  C-5a.  List  of  Written  and/or 
Spoken/Languages  1996 

Table  C-5b.  List  of  Written  and/or  Spoken 
Languages  1993 

• English 

• English 

• French 

• French 

• Spanish 

• German 

• German 

• Spanish 

• Chinese 

• Chinese 

• South  Asian 

• Dutch 

• Italian 

• Ukranian/Russian 

• Polish 

• South  Asian 

• Dutch 

• Italian 

• Yiddish 

• Yiddish 

• Middle  Eastern 

• Hri)rew 

• Ukranian/Russian 

• Polish 

• Japanese 

• Japanese 

• Hebrew 

• Middle  Eastern 

• Sign  Language 

• Aboriginal 

• Sign  T^ngiiagf* 

• Vietnamese 
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Table  Ethnic  Backgoimds  of  Staff  and  Board 


Staff 

Board 

1993 

(n=475) 

1996 

(n=258) 

1993 

(n=137) 

1996 

(11=55) 

Ethnic  Backgrounds 

* British 

104(22%) 

56  (22%) 

37  (26%) 

11  (20%) 

• French 

13(3%) 

4(2%) 

2(2%) 

1(2%) 

• Western  European 

43  (9%) 

14(5%) 

8(6%) 

0 

• Eastmi  European 

10(2%) 

5(2%) 

3 (2%) 

0 

• Meditanranean 

6(1%) 

5(2%) 

0 

0 

• Middle  Eastan 

3(1%) 

2(1%) 

0 

0 

a RnssianAJkranian/ 

7(2%) 

3(1%) 

3(2%) 

2(4%) 

a Aborigmal/Natiye 

4(1%) 

1 (0.4%) 

0 

0 

• South  Asian 

5(1%) 

5(2%) 

3 (2%) 

1(2%) 

• Sooth  East  Asian 

2 (0.4%) 

2(1%) 

0 

0 

• Chinese 

10(2%) 

9(3%) 

2(2%) 

0 

• JafMnese 

2 (0.4%) 

1 (0.4%) 

2(2%) 

0 

a Anstnula/New 

Zealand/Sonth  Padtic 

0 

0 

0 

0 

a Tjiriii  Amaica 

4(1%) 

4(2%) 

0 

0 

• Amakan 

2 (0.4%) 

0 

2 (0.4%) 

0 

a PnninKan 

69  (15%) 

47  (18%) 

14  (14%) 

15  (28%) 

• African 

1 (0.2%) 

0 

1(1%) 

0 

• Jewish 

13  (3%) 

7(3%) 

6(4%) 

1(2%) 

a Black  CarabeanAVest 

Tndian 

3(1%) 

0 

4(3%) 

1(2%) 

• \hiltiple 

50  (11%) 

26  (10%) 

21  (15%) 

6(11%) 

a otha 

2 (0.4%) 

2(1%) 

0 

0 

• NR 

121  (26%) 

62  (24%) 

29(21%) 

16  (30%) 
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Table  C-7  Number  of  Years  Lived  in  Canada 


Staff 

Board 

1993 

(n=475) 

1996 

(n=258) 

1993 

(n=137) 

1996 

(n=55) 

• Mean 

21Jyrs 

19.9  yrs 

28.6  yrs 

23  J yrs 

• Minimnm 

2 yrs 

3 yrs 

10  yrs 

lyr 

• Maximam 

51  yrs 

46 yrs  1 

49  yrs 

43  yrs 

• NR 

191  (76%) 

391  (49%) 

117  (81%) 

49  (91%) 

NR = Non-response 


MOC’s  Description  & Impacts  Page  179 


Appendix  P 


Terms  of  Reference 

for  the  Evaluation  of  the  United  Way  of  Calgary  and  area 
Multicultural  Organizational  Change  Initiative 
by  the  Alberta  Multiculturalism  Commission 
& the  Ministry  of  Alberta  Community  Development 
(Established  November,  1992) 

General 

The  Citizenship  & Heritage  Secretariat  of  Alberta  Community  Development  is  working 
with  the  non-profit  social  service  sector  within  the  Province  of  Alberta  to  facilitate  the 
development  of  managing  diversity  programs  within  the  Secretariat's  ACCESS  mandate.  The 
United  Way  of  Calgary  and  area,  in  collaboration  with  the  Secretariat,  is  undertaking  a three 
year  demonstration  project  in  this  direction.  The  United  Way  project  seeks  to  develop  not-for- 
profit  human  service  sector  agencies  (United  Way  and  its  Member  Agencies)  that  are  free  of 
barriers  to  participation  and  have  the  capacity  to  provide  their  services  to  all  Calgarians.  The 
Secretariat,  working  with  the  United  Way,  is  working  to  create  human  and  material  resources 
which  will  facilitate  the  implementation  of  this  process  in  all  parts  of  Alberta. 

In  order  to  assess  which  of  the  various  approaches  being  implemented  by  the  United 
Way  are  the  most  effective,  and  would  be  useful  to  share  with  other,  similar  organizations 
across  Alberta,  the  Secretariat  has  been  participating  in  the  development  of  an  External 
Evaluative  Process  for  the  United  Way  Project.  This  process  has  involved  the  development  of 
a collaborative  "Stakeholder  Group"  of  people  from  the  United  Way,  the  Cluster  groups  and 
participating  agencies,  as  well  as  the  Secretariat.  The  process  in  Year  1 of  this  project, 
including  the  selection  competition  for  the  Contractor  in  the  fall  of  1992,  has  thus  far  been 
financially  supported  by  the  Kahanoff  Foimdation.  In  order  to  fiiUy  understand  this  complex 
organizational  change  process,  the  Contractor  will  augment  the  organizational  baseline 
assessment  thus  far  developed  with  three  additional  instruments:  Workforce  Demographics, 
Workforce  Attitudes  and  Understandings  related  to  diversity,  and  a sampling  of  consumers  of 
the  agencies  undertaking  the  MOC  process. 

These  4 snapshots  of  how  the  United  Way,  the  4 clusters  and  the  participating  Member 
Organizations  are  proceeding  with  the  MOC  process  will  be  compared  longitudinally  with  re- 
application of  the  4 instruments  in  winter  of  1994/1995.  This  longitudinal  analysis  will  provide 
some  of  the  first  data  on  the  effectiveness  of  the  various  approaches  being  used  in  this  process. 

The  Contractor  will  provide  the  resulting  agency-specific  research  data  back  to  the 
specific  agencies,  and  will  provide  collective  data  to  the  appropriate  Cluster  groups,  the  United 
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Way,  and  the  Stakeholder  Group,  as  well  as  to  the  Minister.  This  will  be  done  after  the  first 
application  of  the  instruments,  in  order  to  establish  the  baseline  from  which  change  will  be 
measured,  and  after  the  re-application  of  the  instruments,  as  well  as  at  the  conclusion  of  the 
longitudinal  comparison. 

The  Contractor  will  also  submit  progress  reports  during  the  period  between  the 
application  and  re-application  of  the  instruments  and  during  the  re-application  and  data  analysis 
phases,  along  the  way  to  an  End  of  Project  report. 

Details 

1.  The  Contractor  will  continue  to  administer  the  baseline  Organizational  Assessment 
Instrument,  analyse  this  data  and,  in  consultation  with  the  Stakeholder  Group,  produce  a 
Baseline  Report  by  the  end  of  November,  1993. 

2.  The  Contractor  will  develop.  Administer,  Analyze  and  develop  a Report  on  2 other 
workforce  instruments  - a WorJtforce  Demographics  instrument  and  a WorJtforce  Attitudes 
and  Issues  about  Diversity  instrument. 

3.  The  Contractor  will  Develop  an  instrument.  Administer,  Analyze  and  develop  a Report 
on  the  impact  of  the  MOC  process  on  the  Consumers  of  Participating  Agencies. 

The  data  and  any  emerging  trends  in  the  Baseline  will  be  analyzed  in  consultation  with 
the  Cluster  groups  and  the  Stakeholder  Group.  Agency-specific  data  will  be  returned  to 
individual  participating  agencies  and  group  data  will  be  submitted  to  the  appropriate 
Clusters  and  the  United  Way,  as  well  as  to  the  Minister. 

4.  The  Contractor  will  Monitor  the  progress  of  the  MOC  process  during  1994/95  through 
meetings  with  MOC  staff  and  the  Stakeholder  Group  and  provide  interim  reports  on  the 
process. 

5.  The  Contractor  will  re-design  and  modify  the  baseline  instruments  as  required.  The 
Contractor  will  then  re-administer  the  4 baseline  instruments  and  analyze  the  data  with 
respect  to  a longitudinal  comparison  with  the  original  baseline.  The  data  and  any 
emerging  trends,  will  be  analyzed  in  consultation  with  the  Stakeholder  Group.  The 
specific  data  will  be  submitted  to  individual  participating  agencies  and  group  data  will  be 
submitted  to  the  appropriate  Clusters  and  the  United  Way  as  well  as  to  the  Minister. 
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6.  An  End  of  Project  Report  will  be  developed  which  will  include  both  quantitative  and 
qualitative  analysis  of  the  entire  United  Way  and  Member  Agency  MOC  process. 

[Note:  this  terms  of  reference  was  modified  when  the  Evaluation  became  split  into  the  Kahanoff 
evaluation  and  the  Workforce  evaluation.  Only  the  workforce  survey  was  re-applied  in  1996  for 
comparison  with  the  1993/94  study.] 
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Appendix  E 


Key  Points  in  the  Time  Line  of  the  United  Way  of  Calgary  and  area  MOC  Initiative 

And  its  Evaluation 


1990: 

• United  Way  of  Calgary  identified  the  need  to  be  more  responsive  to  the  broader 
community.  Changing  demographics  led  the  Boards  of  the  United  Way  and  Member  Agencies 
to  review  funding  priorities.  A Multicultural  Task  force  suggested  that  United  Way  needs  to 
develop  a process  to  address  the  barriers  non-white,  mainstream  Calgarians  may  have  in 
accessing  United  Way  services.  This  process  led  the  United  Way  to  create  a boaid  committee 
to  oversee  a multiple  year  pilot  in  multicultural  change.  United  Way  hires  Carole  Holmes  to 
co-ordinate  the  MOC  activities.  The  initial  idea  was  that  United  Way  would  attempt  internal 
change  first  and  then  work  with  member  agencies  with  their  newly-developed  expertise. 

1991: 

• (April)  United  Way's  Multicultural  Organizational  Change  (MOC)  Board  Committee  struck 
with  a membership  of  2 Board  members,  14  community  members,  and  a Co-ordinator  (Carole 
Holmes).  Chairman  is  United  Way  Board  member,  TaUb  Nanji.  Committee  develops  a vision 
and  mission  and  strategic  plan  for  their  process. 

• (Fall)  MOC  Committee  facilitates  the  United  Way  of  Calgary  internal  assessment  (barriers 
analysis)  of  obstacles  and  other  inappropriate  services  for  clients,  staff  of  the  agency  and 
potential  donors  to  the  organization.  Funding  for  this  is  split  between  Alberta  Multiculturalism 
Commission  and  Canadian  Heritage,  who  each  provide  $10,000  for  the  internal  barriers 
analysis. 

1992: 

• (January)  United  Way  of  Canada  designated  Calgary's  project  as  one  of  four  model 
projects  (Ifcdifax,  Toronto  and  Vancouver  are  the  others)  which  will  run  for  3 years  (1992- 
1995).  The  Kahanoff  Foundation  is  providing  over  half  the  funds  for  Calgary's  project. 

United  Way  has  committed  to  the  remainder  of  funding  (over  $600,000). 

• (April)  Board  of  the  United  Way  invited  Member  Agencies  to  join  the  Multicultural 
Organizational  Change  process  to  participate  in  a pilot  to  address  multicultural  accessibility 
within  the  not-for-profit  human  services  sector.  16  agencies  agree  to  participate  for  three 
years. 

• (March)  A report  on  the  United  Way’s  barriers  analysis.  Enlarging  the  Fabric,  was 
produced  by  the  external  consultant  who  undertook  the  review  with  the  MOC  Committee. 

• (October)  Alberta  Multiculturalism  Commission,  under  its  Access  mandate,  contracted  with 
United  Way  of  Calgary  for  Year  One  of  a three  year  pilot  initiative  to  demonstrate  and 
document  an  organizational  change  process  addressing  accessibility  and  barriers. 
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1993: 

• 16  participating  agencies  (including  United  Way  itself)  work  in  clusters  and  develop  a vision 
and  implementation  strategies  for  a barriers  analysis  and  systems  review.  Organizational 
baseline  reviews  begin  to  be  organized  and  implemented  in  agencies  in  Clusters  One  and  Two. 

• (Spring)  Evaluators  (PlaniNet  Management  and  Consulting  Network)  and  MOC  Committee 
create  an  Evaluation  Stakeholders’  Group  made  up  of  participating  agencies.  In  March, 
PlanrNet  produced  an  Incq)tion  Report  setting  out  the  framework  of  the  1992-95  evaluation. 

• (June)  A 20  person  training  team  was  recruited  and  trained  and  intensive  agency  training 
begins. 

• (Summer/Fall)  Baseline  implementation  of  evaluation  surveys,  interviews,  focus  groups 
happening  across  agencies  and  United  Way.  The  Evaluation  components  are  interspersed  with 
the  agency  barrier  analysis.  Workforce  Survey  applied  in  late  fall  and  early  winter  and  finished 
in  early  1994. 


1994: 

• Agencies  are  working  to  complete  Barriers  Assessments  and  begin  strategizing  on  addressing 
their  barriers.  Most  agencies  not  yet  finished  by  end  of  1994. 

• (January)  Evaluators  produce  an  Evaluation  Baseline  Report  and  a Findings  Report 

• (Fall)  Kahanoff  Evaluation  of  MOC  process,  clusters,  MOC  Committee  and  stakeholders 
takes  place. 


1995: 

• (May)  Evaluators  produced  the  MOC  Evaluation  Report,  which  reports  that  MOC  has 
“substantially  achieved  its  goal... After  three  years,  most  participants  conclude,  the  effects  of 
MOC  are  only  now  beginning  to  take  hold.”  This  report  also  wrapped  up  the  Kahanoff 
Foundation’s  participation  in  the  MOC  process  across  Canada.  Besides  generally  finding  the 
MOC  process  to  have  resulted  in  significant  changes,  the  Plan:Net  report  noted  that  the 
personal  influence  and  impact  of  Carole  Holmes,  the  MOC  Co-ordinator,  had  played  a critical 
role  in  advocating  for  MOC  and  for  educating  and  supporting  the  various  participating  agencies 
and  key  individuals  through  what  was  clearly  a difficult  process. 

• United  Way  re-orients  some  of  its  financial  assistance  programs  to  support  partnerships 
between  “mainstream”  agencies  and  “ethnocultural  communities”  to  serve  “new”  communities, 
provide  organizational  development  support  to  vulnerable  groups,  and,  for  the  first  time  in 
Calgary,  provide  support  to  ethnocultural  agencies  engaged  in  social  support  work  (such  as 
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Calgary  Chinese  Community  Service  Association). 

• Agencies  report  feeling  the  impact  of  provincial  constraints  and  cuts  to  the  human  services 
sector  “ participating  agencies  request  postponing  the  second  implementation  of  the  workforce 
survey  evaluation  to  1996. 

• Carole  Holmes,  the  United  Way  MOC  Co-ordinator,  leaves  project  in  September,  resulting 
in  a shift  in  MOC’s  direction  and  leadership.  Wendy  Charlton  and  Narmin  Ismail-Teja,  the 
Training  Co-ordinators,  job  share  the  Coordinator’s  position. 


1996: 

• Agency  work  continues  with  an  additional  20  participating  agencies  who  are  working  on 
accessibility  planning,  policy  development  and  training. 

• (February)  Implementation  of  a re-designed  survey  to  test  the  baseline  with  agency  staff. 

• (June/July)  The  Evaluators  provide  workshops  back  to  the  14  participating  agencies  on 
the  outcome  of  the  1996  survey. 


1997: 

• The  Evaluators,  working  with  the  original  1992/93  Evaluation  Stakeholders  Group,  complete 
the  analysis  of  the  comparison  between  the  1996  and  1993  evaluations  and  produce 
an  Executive  Summary  of  the  Evaluation  in  July.  The  final,  complete  document  with  all  the 
data,  findings,  instruments,  etc.  is  finished  at  the  end  of  November. 
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ORDER  FORM 


Name: 


Mailing  Address: 


City: 

Province/State:  Postal  Code: 

Phone  / Fax: 

E-mail: 

I would  like  to  order: 

copies  of  MOC’s  Impacts  - Executive  Summary  ® $9.95  each 

(49pp. , including  key  tables) 

&/or  copies  of  MOC’s  Impacts  - The  Final  Report  ® $19.95  each 

(186pp,  complete  with  all  data,  fmdings,  and  tables) 


Please  make  all  cheques  payable  to  the  Proviiicial  Treasurer 
mail,  fax  or  e-mail  to: 


Alberta  Human  Rights  and  Citizenship  Branch 

Alberta  Community  Development 

310,525  11  AVENUE  SW 

CALGARY  AB  CANADA  T2R0C9 

or  fax  to:  403  297  6567 

telephone;  403  297  8407  (or  if  calling  in  Alberta 

call  the  AB.  government  RITE  line;  310  0000) 


If  you  would  like  to  be  added  to  our  mailing  list  and  receive  notices  of  events  and 
opportunities,  please  sign  or  initial  your  approval  here: 
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